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An  Evaluation  of  Redundant  Arrays  of  Disks  using  an  Amdahl  5890 

1.  The  I/O  Crisis 

Over  the  past  10  years,  processing  speed,  memory  speed  and  capacity,  and  disk  capacity  have  all 
grown  tremendously: 

•  Single  chip  processors  have  increased  in  speed  at  the  rate  of  40%-100%  per  year  [Bell  84,  Joy  85] 

•  Caches  have  increased  in  speed  40%  to  100%  per  year 

•  Main  memory  has  quadrupled  in  capacity  every  two  or  three  years  [Moore  75,  Myers  86] 

In  contrast,  disk  access  times  have  undergone  only  modest  performance  improvements.  For  example,  seek 
time  has  improved  only  about  7%  per  year  [Harker  81].  If  not  remedied,  this  imbalanced  system  growth 
will  eventually  lead  to  I/O  limited  systems  [Amdahl  67,  Kim  87].  Continued  improvement  in  system  per¬ 
formance  depends  in  a  large  part  on  I/O  systems  with  higher  data  rate  and  I/O  rate. 

One  way  to  increase  I/O  performance  is  by  using  an  array  of  many  disks  [Kurzweil  88].  By  using 
many  disks,  both  throughput  (MB  per  second)  and  I/O  rate  (I/O’s  per  second),  can  be  increased. 
Throughput  can  be  increased  by  having  many  disks  cooperate  in  transferring  one  block  of  information;  the 
I/O  rate  can  be  increased  by  having  multiple  independent  disks  service  multiple  independent  requests. 
With  multiple  disks,  however,  comes  lower  reliability.  According  to  the  commonly  used  exponential 
model  for  disk  failures  [Schulze  88],  100  disks  have  a  combined  failure  rate  of  100  times  the  failure  rate  of 
a  single  disk.  If  every  disk  failure  caused  data  loss,  a  100  disk  array  would  lost  data  every  few  hundred 
hours.  This  is  intolerable  for  a  supposedly  stable  storage  system.  To  protect  against  data  loss  in  the  face  of 
a  single  disk  failure,  some  sort  of  data  redundancy  must  exist 

This  paper  analyzes  the  performance  of  several  disk  array  redundancy  schemes.  The  performance 
analysis  is  based  on  a  set  of  experiments  carried  out  on  Amdahl  hardware.  In  these  experiments,  we 
explore  several  issues: 

•  What  are  the  basic  differences  in  throughput  and  response  time  between  the  various  redundancy 
schemes? 

•  For  each  redundancy  scheme,  how  do  different  response  time  requirements  affect  throughput? 
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•  How  does  changing  the  size  of  an  I/O  request  affect  performance  of  the  redundancy  schemes? 

•  How  does  changing  the  read/write  ratio  affect  performance  of  the  redundancy  schemes? 

•  What  affect  does  interleaving  data  in  different  units  have  on  performance? 

•  How  do  the  redundancy  schemes  scale  with  increasing  numbers  of  disks? 

2.  Introduction  to  Redundant  Arrays  of  Disks 

In  "A  Case  for  Redundant  Arrays  of  Inexpensive  Disks  (RAID)",  henceforth  referred  to  as  "The 
RAID  paper”  [Patterson  88],  Patterson,  Gibson,  and  Katz  present  five  ways  to  introduce  redundancy  into  an 
array  of  disks:  RAID  Level  1  through  RAID  Level  5.  Using  a  simple  performance  model  of  these  five 
organizations,  they  conclude  that  RAID  Level  I,  mirrored  disks,  and  RAID  Level  5,  rotated  parity,  have 
the  best  performance  potential.  This  paper  focuses  on  these  two  RAID  Levels,  plus  the  additional  RAID 
Level  0.  RAID  Level  0  is  a  non-redundant  array  of  disks,  and  is  added  mainly  to  provide  a  basis  of  com¬ 
parison  between  RAID  Levels  1  and  5.  Figure  1  shows  the  data  layout  in  the  three  redundancy  schemes. 
The  rest  of  this  section  summarizes  the  RAID  Levels— see  [Patterson  88]  for  more  details. 

In  all  organizations,  data  are  interleaved  across  the  disks  [Kim  86,  Salem  86].  We  define  a  stripe  of 
data  to  be  one  unit  of  interleaving  from  each  disk.  For  example,  the  first  stripe  of  data  in  Figure  1  consists 
of  logical  blocks  0,  1,  2,  and  3.  The  storage  efficiency,  a  measure  of  the  capacity  cost  of  redundancy,  is 
defined  to  be  the  effective  (user)  data  capacity  divided  by  the  total  disk  capacity ,  For  RAID  Level  0,  the 
effective  data  capacity  equals  the  total  disk  capacity,  so  the  storage  efficiency  is  100%. 

RAID  Level  1,  mirrored  disks,  is  a  traditional  way  to  incorporate  redundancy  in  an  array  of  disks 
[Bitton  88].  In  RAID  Level  1,  each  datum  is  kept  on  two  distinct  disks:  a  data  disk  and  a  shadow  disk. 
Thus,  for  RAID  Level  1,  the  effective  storage  capacity  is  half  the  total  disk  capacity  and  the  storage 
efficiency  is  50%.  Reads  can  be  serviced  by  either  the  data  disk  or  the  shadow  disk,  but,  to  maintain  con¬ 
sistency,  writes  must  be  serviced  by  both  data  and  shadow  disk. 

RAID  Level  5,  rotated  parity,  incorporates  redundancy  by  maintaining  parity  across  all  disks.  For 
example,  P0  in  Figure  lb  is  the  parity  of  logical  blocks  0,  1,  2,  and  3.  Parity  will  have  to  be  updated  when¬ 
ever  data  is  written.  If  all  parity  information  was  kept  on  one  disk,  this  disk  would  see  many  more  requests 
than  any  data  disk.  To  avoid  a  bottleneck  in  accessing  the  parity  information,  it  is  spread  over  all  disks. 


disk  0  disk  1  disk  2  disk  3 


(a)  RAID  Level  0— non-redundant  array 


disk  0  disk  1  disk  2  disk  3  disk  4 


(b)  RAID  Level  5--rotated  parity.  The  shad¬ 
ed  areas  are  parity. 


disk  4  disk  5  disk  6 


disk  7 


(c)  RAID  Level  1— mirroring.  Shadow  disks  are  shaded. 


Figure  1:  Three  RAID  architectures.  Data  (logical  blocks)  are  interleaved  across  multiple  disks  with 
various  redundancies  added.  In  RAID  Level  0  (Figure  la),  no  redundancy  exists.  Each  stripe  of  data  con- 
sists  of  a  logical  block  from  each  disk.  In  RAID  Level  1  (Figure  lc),  each  data  disk  (disks  0-3)  has  a  sha¬ 
dow  disk  (disks  4-7).  In  RAID  Level  5  (Figure  lb),  parity  for  each  stripe  is  kept  in  a  parity  block.  Which 
physical  disk  the  parity  block  is  kept  on  is  different  for  different  stripes. 


There  are  many  ways  to  spread  this  parity  information  across  disks,  but  this  is  not  within  the  scope  of  this 
paper.  Instead,  we  have  chosen  one  mapping  of  parity  information  onto  disks.  As  shown  in  Figure  lb,  par¬ 
ity  for  stripe  0  is  kept  on  disk  0;  parity  for  stripe  1  is  kept  on  disk  1,  and  so  on.  If  there  are  N  disks  in  the 
array,  the  storage  efficiency  is  -  ^  . 
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3.  A  Simple  Performance  Model 

In  this  section  we  present  the  simple  performance  model  used  by  the  RAID  paper  to  compare  RAID 
Levels.  First,  some  terminology  is  needed.  The  user  request  to  read  or  write  data  is  called  a  logical 
request,  A  physical  request  refers  to  a  logical  request  after  it  has  been  mapped  onto  the  disk  array.  Often, 
due  to  redundancy  information,  the  physical  request  will  involve  more  disk  blocks  than  the  logical  request 
A  disk  access  refers  to  one  contiguous  read  or  write  of  one  disk.  Physical  requests  result  in  one  or  more 
disk  accesses.  A  logical  request  that  involves  all  the  data  in  a  stripe  is  called  a  full  stripe  request  A  logical 
request  that  involves  only  part  of  the  data  in  a  stripe  is  a  partial  stripe  request.  A  special  type  of  partial 
stripe  request  is  an  individual  request,  which  is  a  request  to  exactly  one  disk’s  part  of  a  stripe. 

The  model  in  the  RAID  paper  is  concerned  with  the  maximum  possible  throughput  of  a  disk  system. 
The  model  drives  the  disk  system  with  four  types  of  logical  requests:  full  stripe  reads,  full  stripe  writes, 
individual  reads,  and  individual  writes.  To  estimate  maximum  possible  throughput,  we  consider  the 
efficiency  of  a  RAID:  the  number  of  disk  accesses  of  a  logical  request  divided  by  the  number  of  disk 
accesses  in  its  corresponding  physical  request. 

Because  RAID  Level  0  has  no  redundant  information,  the  number  of  disk  accesses  in  a  physical 
request  is  always  the  same  as  in  its  logical  request  Thus  RAID  Level  0  has  an  efficiency  of  100%,  that  is, 
100%  of  the  disk  accesses  involve  useful  data.  We  normalize  throughput  of  a  RAID  by  defining  relative 
throughput  of  a  RAID  system  running  a  particular  workload  as  the  throughput  of  that  RAID  system  relative 
to  the  throughput  of  a  non-redundant  array  (RAID  Level  0)  running  the  same  workload  (matching  work¬ 
loads  will  be  described  later).  The  simple  model  estimates  relative  throughput  by  the  fraction  of  disk 
accesses  involving  useful  data.  For  example,  if  the  physical  request  involves  twice  as  many  disks  accesses 
as  its  corresponding  logical  request,  i.e.  the  logical  to  physical  mapping  doubled  the  number  of  disks 
accesses  involved,  then  50%  of  the  disk  accesses  would  involve  useful  data  and  the  simple  model  would 
estimate  the  relative  throughput  to  be  50%. 

For  all  the  RAID  Levels  that  we  are  concerned  with,  assuming  no  failed  disks,  data  can  be  read 
without  accessing  any  redundancy  information  (these  experiments  do  not  measure  performance  when  one 
or  more  disks  are  not  operational).  Because  of  this,  the  mapping  from  logical  read  requests  to  physical 
requests  adds  no  extra  disks,  and  the  simple  model  predicts  a  relative  throughput  for  RAID  Levels  0,  1,  and 
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5  reads  of  100%.  As  mentioned  above,  RAID  Level  0  also  has,  by  definition,  a  relative  throughput  of 
100%  for  writes.  However,  for  RAID  Levels  1  and  5,  physical  write  requests  involve  more  disk  accesses 
than  their  logical  write  requests,  and  relative  throughput  becomes  less  than  100%. 

To  write  data  in  RAID  Level  1,  both  the  data  disk  and  the  shadow  disk  must  be  written.  Thus,  a 
RAID  Level  1  physical  write  request  has  twice  the  number  of  disk  accesses  as  the  corresponding  logical 
requesL  The  simple  model  estimates  relative  throughput  at  50%  for  any  size  RAID  Level  1  write. 

For  RAID  Level  5,  both  the  data  disk(s)  and  the  parity  information  need  to  be  updated.  To  compute 
the  new  parity,  some  reads  may  need  to  be  issued.  Some  of  these  reads  snapshot  the  image  on  disk  before 
those  blocks  are  overwritten.  We  call  these  pre-reads.  How  much  information  needs  to  be  read  depends 
on  the  size  of  the  logical  write  request  For  full  stripe  writes,  no  reads  are  needed,  since  the  new  data  com¬ 
pletely  determines  the  new  parity  of  the  stripe.  Thus,  with  an  N  disk  array,  a  full  stripe  logical  write 
request  involves  N-l  disk  accesses,  and  the  physical  request  involves  N  disk  accesses.  This  leads  us  to 
estimate  relative  throughput  as  .  For  partial  stripe  writes,  parity  may  be  computed  either  by  1)  pre- 

reading  the  current  (before  writing)  data  on  the  data  disk(s)  and  current  parity  of  the  stripe  or  2)  reading  the 
current  data  in  the  rest  of  the  stripe.  For  example,  in  Figure  lb,  to  write  logical  blocks  0  and  1,  we  can 
either  1)  pre-read  logical  blocks  0  and  1  and  parity  block  P0  or  2)  read  logical  blocks  2  and  3.  With  a  par¬ 
tial  stripe  write  of  D  (less  than  N-l)  data  disks,  the  first  method  of  computing  parity  involves  D+l  dick 
pre-reads,  and  the  second  method  involves  N—(D  +1)  disk  reads.  For  an  individual  stripe  request  (D=l) 
the  first  method  is  better  for  N> 4.  With  this  first  method,  an  individual  request,  involving  one  disk  access, 
generates  a  physical  request  involving  four  disk  accesses  (two  to  read  the  current  data  and  current  parity 
and  two  to  write  the  new  data  and  new  parity).  This  leads  us  to  estimate  relative  throughput  as  25%  for 
individual  stripe  writes  in  RAID  Level  5. 

The  estimates  for  full  and  individual  requests  for  both  RAID  Levels  1  and  5  are  summarized  in  Fig¬ 
ure  2. 

4.  Goals  and  Refinements 

Our  overall  goal  is  to  understand  more  fully  how  RAID  Levels  1  and  5  perform.  This  includes 
exploring  aspects  of  implementation,  workload  characterization,  and  performance  evaluation.  In 


100% 


100%  100% 


100% 


100% 


Figure  2:  Relative  Throughput  According  to  a  Simple  Model.  Shown  is  the  estimated  throughput  of 
RAID  Level  1  (mirrored  RAID)  and  RAID  Level  5  (rotated  parity  RAID)  as  a  percentage  of  the  estimated 
throughput  of  RAID  Level  0  (non-redundant  RAID)  [Patterson  88].  RAID  Levei  5  large  write  perfor¬ 
mance  is  calculated  assuming  II  total  disks  ( N=ll ). 


particular,  the  performance  estimates  above  dealt  with  maximum  possible  throughput,  expressed  in  terms 
of  relative  throughput.  A  specific  goal  of  the  experiments  described  here  is  to  measure  the  performance  of 
RAID  Levels  1  and  5  and  to  compare  this  measured  performance  against  the  simple  performance  estimates 
in  the  RAID  paper.  The  performance  characterization  in  these  experiments  differs  from  the  RAID  paper  in 
the  following  areas: 

•  Real  hardware'.  The  analysis  done  in  the  RAID  paper  was  a  purely  theoretical  analysis.  It  assumed  a 
constant  time  for  disk  accesses  and  ignored  processing  overhead.  Because  these  experiments  were  car¬ 
ried  out  on  an  actual  machine  with  disks,  they  have  no  need  to  make  any  of  these  simplifying  assump¬ 


tions. 
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•  Response  time :  The  only  performance  metric  in  the  RAID  paper  was  maximum  possible  throughput. 
These  experiments  will  measure  and  control  both  throughput  and  response  time. 

•  Synthetic  workload :  Because  the  analysis  in  the  RAID  paper  was  theoretical,  it  used  extremely  simple, 
therefore  unrealistic,  workloads.  These  experiments  refine  the  workloads  in  three  ways: 

(1)  The  RAID  paper  workloads  had  a  constant  logical  request  size  of  either  100%  full  stripe 
requests  or  100%  individual  requests.  These  experiments  deal  with  a  distribution  of  request 
sizes,  including  partial  stripe  accesses  and  accesses  larger  than  a  full  stripe. 

(2)  The  RAID  paper  workloads  were  either  100%  reads  or  100%  writes.  These  experiments 
explore  a  range  of  read/write  ratios. 

(3)  The  RAID  paper  used  an  infinite  workload,  i.e.  the  disks  were  fully  utilized.  These  experi¬ 
ments  introduce  contention,  resulting  in  more  realistic  (suboptimal)  disk  utilization. 

Note  that  these  experiments  are  not  running  application  programs  (benchmarks),  but  rather  an 
artificially  generated  distribution  of  I/O  requests  (synthetic  workload).  We  choose  to  use  synthetic  work¬ 
loads  because  they  are  easier  to  parameterize  than  benchmarks,  making  it  possible  to  explore  a  range  of 
different  user  workloads.  Also,  running  application  programs  require  an  underlying  file  system,  which  we 
do  not  have. 

5.  Comparing  RAID  Levels 

When  comparing  RAID  Levels,  we  are  interested  in  performance  (throughput  and  response  time) 
and  cost  Comparing  RAID  Levels  in  these  two  areas  is  no  easy  task.  Because  the  storage  efficiency 

differs  between  RAID  Levels  0  (100%),  1  (50%),  and  5  (-^-),  RAID  systems  with  the  same  user  data 

capacity  need  different  numbers  of  disks.  Alternatively,  with  a  fixed  number  of  disks,  different  RAID  Lev¬ 
els  will  have  different  user  data  capacities.  There  are  at  least  two  ways  to  address  this  issue. 

5.1.  Constant  Number  of  Total  Disks 

The  first  option  is  to  keep  the  total  number  of  disks  constant  between  RAID  Levels  Comparing  costs 
with  this  option  is  trivial.  Since  all  RAID  Levels  use  identical  hardware,  cost  is  equal.  However,  compar¬ 
ing  the  performance  of  such  RAID  systems  is  tricky.  To  have  a  valid  basis  for  comparison,  equal  work- 


loads  must  be  presented  to  all  systems.  Unfortunately,  it  is  unclear  how  to  define  an  equal  workload 
between  systems  with  different  data  capacities.  For  example,  consider  two  disk  systems,  A  and  B,  both 
with  the  same  number  of  total  disks.  Suppose  that  system  A  has  a  storage  efficiency  of  50%  and  system  B 
has  a  storage  efficiency  of  100%.  Thus,  system  B  has  twice  the  user  data  capacity  as  system  A.  If  A  and  B 
receive  the  same  workload,  then  the  data  in  B  is  accessed  half  as  frequently  as  the  data  in  A.  To  compen¬ 
sate,  we  may  wish  to  present  B  with  double  the  workload  that  A  receives.  Unfortunately,  it  is  unclear  what 
constitutes  double  a  workload:  double  the  request  rate?  Double  the  request  size?  Double  the  unit  of  inter¬ 
leaving?  The  second  option  in  comparing  RAID  Levels  takes  a  different  approach  to  resolve  this  difficulty. 

52.  Constant  Number  of  Data  Disks 

The  second  option,  which  is  the  one  used  in  these  experiments,  maintains  equal  data  capacities 
between  RAID  Levels.  Presenting  identical  workloads  to  each  system  makes  comparing  performance  far 
simpler.  However,  with  D  disks  of  user  data,  RAID  Level  0  needs  D  total  disks,  RAID  Level  1  needs  2D 
total  disks  and  RAID  Level  5  needs  D+l  total  disks.  Thus,  costs  and  raw  disk  bandwidth  of  the  different 
RAID  Levels  are  no  longer  equal.  We  must  therefore  factor  in  costs  when  presenting  performance. 

One  method  to  factor  in  costs  is  to  simply  present  the  raw  performance  and  cost  separately  For 
example,  in  one  of  the  experiments,  a  RAID  Level  1  used  20  disks  and  yielded  a  throughput  of  20  MB/s. 
The  corresponding  RAID  Level  5  system  used  1 1  disks  and  yielded  a  throughput  of  10  MB/s.  In  general, 
RAID  Level  1  needs  nearly  twice  as  many  disks  as  RAID  Level  5  and  has  much  higher  cost  Then,  having 
more  disks,  RAID  Level  1  generally  yields  higher  performance  than  RAID  Level  5.  It  then  becomes  the 
reader’s  responsibility  to  synthesize  this  performance  and  cost  data. 

A  second  method  to  combine  performance  and  cost  is  to  divide  the  performance  by  the  number  of 
disks.  As  this  only  makes  sense  for  throughput,  response  time  will  be  addressed  separately.  RAID  Level  1 
has  twice  as  many  disks  as  RAID  Level  0,  and  so  we  divide  RAID  Level  1  throughput  by  two  to  normalize 
relative  to  RAID  Level  0.  By  dividing  the  throughput  by  the  number  of  disks,  we  are  tacitly  assuming  that 
a  RAID  Level  0  with  2D  disks  should  perform  twice  as  well  as  a  RAID  Level  0  with  D  disks  (see  section 
10.3).  This  assumption  can  be  false  if  performance  is  not  disk  limited.  In  general,  we  may  be  unfairly 
penalizing  RAID  Level  1  because  we  are  not  providing  RAID  Level  1  with  twice  the  total  resources  (pro- 
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cessor,  memory,  etc.)  of  RAID  Level  0.  We  are  only  doubling  the  disk  resources.  In  particular,  if  CPU 
power  is  the  limiting  factor  to  performance,  then  doubling  the  disk  resources  will  not  double  throughput. 
CPU  power  tends  to  limit  performance  as  more  disks  are  used.  Therefore,  we  limit  the  number  of  disks 
used  to  ensure  that  CPU  power  does  not  greatly  impact  performance  and  RAID  Levels  with  more  disks  are 
not  unfairly  penalized.  We  will  limit  almost  all  experiments  in  this  paper  to  20  disks  or  less.  To  check  that 
this  method  of  presenting  data  is  fair,  we  verify  that  throughput  per  disk  remains  constant  as  we  scale  up 
the  number  of  disks  used  (see  section  10.3).  This  second  method  of  combining  throughput  and  cost  is  the 
one  used  in  this  paper. 

Although  throughput  scales  with  the  number  of  disks  used,  response  time  does  not  Unless  otherwise 
mentioned,  response  time  in  this  paper  is  defined  as  the  time  in  which  90%  of  the  requests  in  the  run  were 
serviced,  similar  to  [Anon  85].  For  example,  a  response  time  of  I  second  would  mean  that  90%  of  all 
requests  in  that  run  returned  to  the  user  within  1  second.  To  maintain  a  valid  comparison  between  RAID 
Levels,  we  vary  the  rate  of  requests  and  force  different  RAID  Levels  to  have  the  same  response  times. 
With  this  equal  response  time,  we  then  compare  the  throughput  of  the  different  RAID  Levels. 

In  summary,  we  compare  different  RAID  Levels  by: 

(1)  maintaining  equal  user  data  capacity  to  simplify  the  equalization  of  workloads 

(2)  forcing  comparable  response  time  for  all  RAID  Levels 

(3)  measuring  throughput  and  dividing  by  the  number  of  disks  involved  to  get  throughput  per  disk  as 
the  main  performance  metric. 

S3.  Two  Entire  Systems 

As  a  final  note,  another  approach  to  comparing  RAID  Levels  is  possible.  We  show  this  option  in 
Figure  3.  This  approach  is  easiest  to  explain  for  comparing  RAID  Level  0  and  1,  but  it  also  generalizes  to 
RAID  Level  5. 

Consider  a  system  with  D  disks  and  one  CPU.  Conceptually,  we  will  form  a  RAID  Level  1  with  two 
such  systems,  systems  A  and  B.  Each  system  in  the  RAID  Level  1  will  contain  half  the  data  disks  along 
with  their  corresponding  shadow  disks.  Requests  to  the  RAID  Level  1  as  a  whole  will  be  serviced  in  part 
by  each  of  the  two  systems.  Requests  that  span  more  than  one  disk  will  be  broken  up  and  serviced  in  part 
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System  A 


System  B 


Figure  3:  Alternate  Way  to  Compare  RAID  Levels.  This  figure  shows  a  way  to  map  RAID  Level  1  onto 
two  distinct  systems  A  and  B,  Even  numbered  logical  blocks  are  stored  in  System  A;  odd  numbered  logi¬ 
cal  blocks  are  stored  in  System  B.  Each  system  will  receive  exactly  half  the  total  workload.  Thus,  to  esti¬ 
mate  total  throughput,  we  need  only  measure  the  throughput  of  one  of  the  systems.  This  has  the  advantage 
of  needing  only  half  the  disk  and  CPU  resources.  Also,  the  system  that  we  measure  will  have  the  same 
CPU  resources  per  disk  as  a  RAID  Level  0. 


by  system  A  and  in  part  by  system  B,  Similarly,  half  the  requests  that  need  only  one  disk  will  be  serviced 
by  system  A  and  half  will  be  serviced  by  system  B.  The  key  to  this  method  is  that  each  system  will  see  an 
identical  load.  Because  of  this,  we  need  only  measure  the  throughput  of  one  of  these  systems  and  multiply 
by  two  to  calculate  the  throughput  of  the  entire  RAID  Level  1.  Note  that  the  conceptual  system  has  double 
the  entire  hardware  configuration  of  a  corresponding  RAID  Level  0  system,  not  just  double  the  number  of 
disks.  Because  of  this,  the  cost  of  the  resulting  RAID  Level  1  is  exactly  double  the  cost  of  the  correspond¬ 
ing  RAID  Level  0  and  dividing  the  resulting  calculated  RAID  Level  1  throughput  by  two  will  always  yield 
a  fair  throughput  per  cost  figure. 

This  method,  though  superior  in  comparing  throughput  per  cost,  does  not  accurately  model  response 
time.  We  could  assume  response  time  is  the  same  on  both  halves,  as  they  do  the  same  work.  However, 
this  ignores  unsynchronized  disks.  Because  of  this  difficulty  in  measuring  response  time,  we  choose  to  use 
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the  previous  method  (constant  number  of  data  disks). 

6.  Experiment  Implementation 

Experiments  were  run  on  an  Amdahl  mainframe  under  UTS,  which  is  a  version  of  System  V  Unix. 
See  Table  1  and  Figure  4  for  hardware  statistics  and  channel  architecture.  Note  that  we  have  only  one  disk 
per  string.  This  prevents  channel  conflicts  and  approximates  a  system  which  uses  buffers  to  avoid  data 
transfer  conflicts. 

By  using  synthetic  workloads  instead  of  application  software,  we  eliminate  the  need  for  a  file  system 
structure.  Instead,  we  simply  read  and  write  bytes  on  the  disks.  This  enables  us  to  simulate  a  large  range 
of  I/O  access  patterns  without  dealing  with  the  logistics  of  many  benchmarks.  In  our  experiment,  the  reads 
and  writes  are  done  by  user  processes  accessing  raw  devices  [UTS  88]. 

6.1.  Process  Structure 

The  simplest  structure  to  produce  a  synthetic  workload  would  be  a  single  process  issuing  all  I/O’s. 
However,  because  UTS  does  not  support  asynchronous  I/O,  it  is  impossible  to  have  more  than  one  out¬ 
standing  I/O  per  process.  Thus,  at  the  start  of  each  experiment,  one  master  process  (the  parent)  creates  one 
child  process  for  each  disk.  This  child  process  will  be  used  as  a  user-level  device  driver  and  will  drive  one 
disk.  All  communication  is  done  via  IPC  messages  between  the  parent  process  and  an  individual  child 


Processor  Resources:  Amdahl  5890-300e 


processors 

2 

cycle  time 

15  ns 

memory  size 

256  MB 

data  cache 

64  KB 

instruction  cache 

32  KB 

channels 

64 

Disk  Resources:  Amdahl  6380 

cylinders/disk 

885 

tracks/cylinder 

15 

sectors/track 

10 

bytes/sector  (fixed  format) 

4KB 

average  seek 

15  ms 

average  rotational  latency 

8.3  ms 

maximum  transfer  rate 

2.4MB/S 

disk  caching 

off 

Table  1:  Hardware  Statistics  of  Processor  and  Disk  Resources  [Amdahl  6380,  Amdahl  5890].  We  assume  rotation¬ 
al  latency  is  distributed  uniformly  between  0  and  16.7  ms.  We  also  assume  seeks  are  distributed  uniformly  between  8 
ms  and  27  ms,  an  approximation  of  the  seek  time  data  in  [Thisquen  88], 
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Figure  4:  Disk  -  Memory  Bus  Architecture.  This  figure  shows  how  the  disks  are  connected  to  the 
memory  bus  in  most  of  our  experiments  [Buzen  86].  Note  that  we  use  only  one  disk  per  channel  path  (path 
to  memory).  This  avoids  channel  conflicts  and  RPS  misses. 


process-there  is  no  communication  between  child  processes.  The  child  process  has  no  concept  of  RAID 
Levels.  Rather,  the  parent  is  responsible  for  generating  the  logical  request,  mapping  the  logical  request 
into  a  number  of  physical  requests,  and  passing  the  physical  requests  to  the  children.  The  children  see  sim¬ 
ply  a  stream  of  disk  accesses  of  the  form:  read/write,  location  on  disk,  size  of  access. 

Each  child  process  has  a  queue  of  requests,  and  waits  until  there  is  a  request  in  its  queue  to  carry  out 
that  request  on  its  assigned  disk  (using  UNIX  read  or  write).  When  the  request  returns,  the  child  will 
inform  the  parent  of  its  return  and  process  the  next  request  in  its  queue.  Note  that  no  actual  data  passes 
between  the  parent  and  the  child.  All  data  is  read  into  a  garbage  buffer  and  thrown  away  by  the  child. 
Data  to  be  written  also  comes  from  a  garbage  buffer. 

6.2.  RAID  Level  0 

For  a  non-redundant  array,  individual  logical  reads  and  writes  each  result  in  a  single  disk  access. 
Because  there  is  no  read  buffering  on  the  disks  we  are  using,  physical  reads  and  physical  writes  have  the 
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Figure  5:  Parent  -  Child  Communication  Structure.  This  figure  shows  how  the  narent  nrn cess  rnm 
municates  with  the  child  processes  to  issue  and  return  disk  accesses.  The  parent  (masterTprocess  asynchro- 
nously  ^ues  dtsk  commands  to  a  queue  for  each  child  process,  which  act  as  uiT-kvel 
turn,  the  child  processes  synchronously  issue  commands  to  a  disk. 


same  disk  semce  time.  Consequently,  in  this  experiment,  we  assume  performance  for  RAID  Level  0  is 
independent  of  the  percentage  of  reads  and  writes. 

63.  RAID  Level  1 

To  execute  a  mirrored  read  of  a  data  block,  die  sysem  must  decide  if  the  data  disk  or  t|m  shadow 
disk  will  carry  out  the  access.  In  our  experiment,  we  6rst  look  for  a  disk  which  is  idle.  If  both  disks  are 
idle  or  both  are  busy,  we  choose  the  disk  which  will  yield  the  shorter  seek.  To  make  this  choice,  we  save 
the  location  of  the  previous  request  to  that  physical  disk. 

A  possible  optimization  which  do  not  make  is  to  have  a  read  serviced  in  part  by  a  data  disk  and  in 
part  by  a  shadow  disk.  This  implementation  would  increase  throughput  if  the  system  was  fairly  idle,  since 
it  would  make  better  use  of  both  copies  of  each  datum.  However,  it  would  decrease  throughput  for  a 
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loaded  system,  since  each  disk  would  transferring  less  data  per  seek. 

6.4.  RAID  Level  5 

A  RAID  Level  5  write  must  update  both  the  data  blocks  and  the  parity  associated  with  those  data 
blocks.  Because  a  full  stripe  write  will  write  an  entire  stripe,  it  involves  all  the  data  needed  to  compute  par¬ 
ity,  and  no  additional  information  needs  to  be  read. 

For  partial  stripe,  writes,  two  interesting  implementation  questions  arise.  First,  which  disks  should 
we  read  to  compute  parity?  One  choice  is  to  read  the  current  data  and  current  parity,  compare  the  current 
data  and  new  data,  and  change  the  parity  correspondingly.  When  writing  D  disks  of  data  out  of  N  total 
disks,  this  choice  results  in  D+l  disk  reads  to  compute  parity.  The  second  choice  is  to  read  the  data  in  the 
rest  of  the  stripe  and  simply  recompute  parity  of  the  stripe.  This  results  in  N-D-l  disk  reads  to  compute 
parity.  In  our  experiment,  we  choose  the  option  that  requires  the  fewest  disk  accesses.  Partial  stripes 
requests  can  range  in  size  from  1  disk  to  N-2  disks.  For  an  individual  request,  we  read  the  current  data  and 
the  current  parity.  This  leads  to  a  relative  throughput  of  25%.  For  a  partial  stripe  write  of  N-2  disks,  we 
read  the  remaining  data  disk  and  write  the  N-2  original  data  disks  plus  parity.  This  leads  to  a  relative 
throughput  of  (N  disks  need  to  be  accessed  in  RAID  Level  5  relative  to  N-2  disks  in  RAID  Level  0). 

Second,  if  we  choose  to  read  the  current  data  and  current  parity,  how  do  we  schedule  the  new  data 
and  new  parity  writes?  The  new  data  can  be  written  immediately  after  the  current  data  has  been  read.  This 
new  data  write  will  see  a  zero  seek  plus  a  full  rotation.  We  assume  the  kernel  can  do  the  exclusive-ors 
necessary  to  compute  the  new  parity  block  in  the  time  the  disk  rotates  once.  Thus,  we  write  the  new  parity 
block  out  one  rotation  after  the  current  parity  block  has  been  read  (exactly  the  same  as  the  data  block). 
This  is  a  simplifying  assumption,  as  the  current  data  may  not  have  been  read  yet.  We  believe  this  assump¬ 
tion  is  valid,  as  the  device  driver  could  simply  delay  the  parity  block  read  and  write  until  the  data  block  is 
about  to  be  read.  Because  a  request  is  not  considered  complete  until  all  accesses  related  to  that  request 
have  finished,  such  a  minor  scheduling  delay  would  only  marginally  affect  response  time  and  should  not 
affect  throughput  at  all. 
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6.5.  Response  Time  Control  and  Stabilization 

To  achieve  a  certain  target  response  time,  we  control  the  number  of  outstanding  logical  requests  in 
the  system  ( queue  depth).  We  periodically  check  the  number  of  requests  that  were  satisfied  within  the  tar¬ 
get  response  time,  and  adjust  the  allowed  number  of  outstanding  logical  requests  accordingly.  To  avoid 
including  the  start  up  time  in  the  performance  analysis,  we  discard  statistics  gathered  before  the  queue 
depth  has  stabilized.  Queue  depth  stabilization  in  this  context  means  being  checkpointed  at  the  same  value 
more  than  twice.  Once  the  queue  depth  has  stabilized  we  begin  collecting  data.  The  throughput  for  the  run 
is  collected  every  20  seconds.  The  run  has  stabilized  when  two  conditions  are  met 

(1)  The  previous  two  throughput  reports  are  within  1%  of  the  current  throughput  report 

(2)  90%±l%  of  all  requests  have  been  fulfilled  within  the  target  response  time. 

Once  the  run  has  stabilized,  we  cease  sending  new  requests  and  await  the  completion  of  any  outstanding 
requests.  While  we  await  the  completion  of  all  requests,  throughput  will  drop,  though  not  enough  to 
significantly  affect  the  overall  performance. 

6.6.  Synthetic  Workload  Implementation 

The  parameters  of  the  synthetic  workload  are  response  time  target,  read/write  ratio,  request  size  dis¬ 
tribution,  and  data  distribution.  When  the  parent  process  generates  a  request,  it  stochastically  chooses  read 
or  write,  request  size,  and  starting  location  of  the  data.  Each  choice  is  made  independently  of  past  choices. 
Note  that  these  parameters  determine  the  logical  request  stream  and  are  independent  of  the  RAID  organiza¬ 
tion  (the  logical  to  physical  mapping). 

The  request  size  is  generated  in  a  number  of  different  ways,  depending  on  the  workload.  One 
method  is  to  force  all  accesses  for  a  run  to  be  a  fixed  size.  This  is  the  assumption  used  in  the  simple  model, 
for  example,  100%  full  stripe  requests.  A  second  method  is  to  choose  a  distribution  of  request  sizes.  We 
choose  two  distributions  in  particular:  exponentials  with  small  means  and  normals  with  large  means  and 
standard  deviations.  Once  we  choose  the  request  size,  we  choose  the  placement  of  this  data  according  to 
the  data  distribution. 

Because  there  is  no  file  system  structure,  we  choose  the  data  distribution  by  choosing  the  starting 
location  of  the  logical  request.  In  our  workload,  we  break  the  starting  location  into  two  orthogonal 
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components:  starting  disk  and  stripe  number  on  that  disk.  The  starting  stripe  number  on  the  disk  is  always 
distributed  uniformly  over  all  stripes  on  that  disk. 

We  used  several  methods  for  choosing  the  starting  disk.  We  call  the  first  method  uniform  alignment. 
This  is  intended  to  be  the  data  distribution  which  yields  optimal  performance.  Uniform  alignment  tries  to 
1)  minimize  the  number  of  partial  stripes,  and  2)  spread  the  I/O  load  evenly  across  disks.  It  minimizes  the 
number  of  partial  stripes  by  aligning  data  on  full  stripe  boundaries  where  possible.  For  request  sizes 
smaller  than  a  full  stripe,  it  chooses  the  starting  disk  according  to  a  uniform  distribution. 

The  second  method  of  choosing  the  starting  disk  is  derived  from  a  normal  distribution  (Figure  6).  In 
our  tests,  the  standard  deviation  (in  disks)  of  our  normal  distribution  equals  the  number  of  data  disks.  We 
refer  to  this  data  distribution  as  the  skewed  distribution. 
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Figure  6:  Using  the  Skewed  Data  Distribution  to  Select  the  Starting  Disk.  The  distribution  of  data 
accesses  is  determined  by  both  starting  disk  and  stripe  number  on  that  disk.  The  choice  of  starting  stripe  is 
always  distributed  uniformly  over  all  stripes.  Starting  disk  is  chosen  according  to  various  distributions. 
The  distribution  shown  here,  the  skewed  data  distribudon,  is  the  truncated  right  half  of  a  normal  distribu¬ 
tion  with  a  standard  deviation  of  10  disks. 
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7.  Result  Presentation 

The  simple  model  analyzed  performance  under  four  types  of  workloads:  large  reads,  large  writes, 
small  reads,  and  small  writes.  While  continuing  to  direct  our  experiments  toward  understanding  these  four 
types  of  workloads,  we  seek  to  make  them  more  realistic  as  discussed  in  Section  4.  Rather  than  jump  from 
the  analysis  presented  in  the  RAID  paper  directly  to  our  most  realistic  workload,  we  make  the  transition  in 
a  number  of  smaller  steps.  These  steps  are  summarized  in  Table  2. 

We  start  by  running  the  same  workload  as  the  RAID  paper,  request  sizes  are  full  stripe  or  individual; 
requests  are  all  reads  or  all  writes.  In  Section  8.1,  we  analyze  an  idle  system  to  break  down  the  time  for  a 
basic  I/O.  Next,  in  Section  8.2,  we  attempt  to  duplicate  the  assumptions  made  in  the  RAID  paper  of  unlim¬ 
ited  response  time  by  analyzing  a  saturated  system.  In  8.3,  we  make  the  experiment  more  realistic  by  con¬ 
trolling  and  equalizing  the  response  times. 

When  we  have  finished  analyzing  the  RAID  paper  workload,  we  begin  to  use  more  varied  work¬ 
loads.  We  again  make  this  transition  by  changing  one  aspect  of  the  workload  at  a  time.  In  9.1,  we  remove 
the  assumption  of  constant  request  size  by  using  a  distribution  of  request  sizes.  In  9.2,  we  skew  the  data 

distribution.  As  our  last  step  in  making  the  experiment  more  realistic,  we  allow  workloads  with  both  reads 
and  writes. 


Section 

Description 

Response 

Time 

Request 

Size 

Data 

Distribution 

Read  Write 
Mixture 

8.1 

Breaking  down  a  basic  request 

minimum 

fixed 

uniform  aligned 

unmixed 

8.2 

Unlimited  response  time 

unlimited 

fixed 

unmixed 

8.3 

Set  target  response  time 

target 

fixed 

unmixed 

9.1 

Distribute  request  sizes 

target 

distributed 

unmixed 

9.2 

Skewed  data  distribution 

target 

distributed 

skewed 

unmixed 

9.3 

Mix  reads  and  writes 

target 

distributed 

skewed 

mixed 

Table  2:  Stages  of  Results.  A  guide  to  the  results  in  Sections  8  and  9.  The  workload  becomes  more  real 
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tions  9. 1  -9.3,  we  change  the  request  size,  data  distribution,  and  read/write  ratio.  S 
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Lastly,  we  explore  several  additional  issues,  such  as  further  varying  the  request  sizes,  comparing  sec¬ 
tor  and  track  interleaving,  and  scaling  the  number  of  data  disks.  As  a  final  caveat  we  look  briefly  at  the 
effects  of  connecting  multiple  disks  per  channel. 

Unless  otherwise  noted,  experiments  are  run  with  10  data  disks  and  track  striping.  Thus,  a  full  stripe 
is  10  tracks  (400  KB)  and  an  individual  request  is  1  track  (40  KB). 

8.  The  RAID  Paper  Workload 

Request  sizes  in  the  RAID  paper  workload  are  large  (a  full  stripe)  or  small  (individual).  Runs  are 
either  100%  reads  or  100%  writes.  With  the  RAID  paper  assumption  of  infinite  workload,  disks  are  always 
100%  utilized,  and  data  distribution  has  no  effect.  To  approximate  this,  we  use  a  very  high  workload  and 
the  uniform  aligned  data  distribution. 

8.1.  Analyzing  an  Idle  System 

To  understand  the  supporting  hardware,  we  first  break  down  the  time  of  a  basic  I/O.  This  is  done  by 
analyzing  the  average  response  time  of  a  single  request  in  an  idle  system.  Average  response  time  is  not  the 
90%  response  time  used  in  the  majority  of  this  paper,  but  rather  the  arithmetic  average  of  all  response 
times.  We  trace  the  lifetime  of  an  average  request  by  measuring  the  time  spent  in  various  stages  of  servic¬ 
ing  the  request  (Figure  7).  We  also  measure  the  total  average  response  time  of  the  requests  and  check  that 
this  is  equal  to  the  sum  of  the  times  spent  in  each  stage.  In  all  cases,  the  average  response  time  is  within  1 
ms  of  the  sum  of  the  time  spent  in  each  stage. 

Average  response  time  breaks  down  as  follows: 

•  request  overhead :  CPU  time  spent  in  sending  messages  between  parent  process  and  child  processes. 

•  IO  CPU  time :  CPU  time  for  children  to  issue  and  receive  I/O’s,  including  the  channel  processing  time. 
IO  CPU  time  ranges  from  1.5  ms  to  1.8  ms. 

•  disconnect  time:  time  spent  in  seek  and  rotational  latency.  An  average  seek  is  15  ms  and  the  average 
rotational  latency  is  8.3  ms. 

•  synchronization:  additional  time  due  to  multiple  independent  disks  doing  random  seeks  and  rotations. 
This  is  not  measured,  but  rather  calculated  (more  in  the  next  section)  based  on  statistics  given  in  Section 


6. 
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•  connect  time:  time  spent  in  transferring  data  [IBM  87].  For  full  track  data  transfers,  connect  time  is 
16.2  ms. 

Note  that  request  overhead  is  measured  per  logical  request.  IO  CPU  time,  disconnect  time,  pending  time, 
and  connect  time  are  all  measured  per  disk  access. 

8.1.1.  Synchronizing  Multiple  Disks 

There  are  two  types  of  synchronization  between  multiple  disks.  In  most  cases,  such  as  RAID  Level 
0  full  stripe  reads  or  writes  and  RAID  Level  1  individual  writes,  only  rotations  need  to  be  synchronized. 
Seek  distance  among  disks  that  cooperate  in  a  request  are  usually  the  same~the  sole  exception  being  RAID 
Level  5  small  writes.  Because  workloads  are  homogeneous,  disks  that  cooperate  in  any  request  cooperate 
for  all  requests.  For  example,  for  RAID  Level  1  individual  writes,  each  data  or  shadow  disk  pair  always 
seek  to  the  same  track.  Thus,  for  RAID  Level  0  full  stripe  reads  or  writes,  RAID  Level  1  full  stripe  reads 
or  writes  and  individual  writes,  and  RAID  Level  5  full  stripe  reads  or  writes,  multiple- rotations  lengthen  the 
total  request  time  in  proportion  to  the  number  of  disks  involved.  Synchronizing  N  multiple  rotations  is 
equivalent  to  taking  the  maximum  of  N  uniform  random  variables  distributed  between  0  and  16.7  ms.  The 
expected  value  of  such  a  distribution  is  ^xlb.7  ms.  The  difference  between  this  expected  value  and 
the  average  rotational  latency  of  one  disk  (8.3  ms)  is  the  penalty  for  synchronizing  multiple  rotations. 

The  second  type  of  synchronization,  synchronizing  both  seeks  and  rotations,  is  relevant  only  for 
RAID  Level  5  individual  writes,  and  is  discussed  in  Section  8.1.4. 

8.1.2.  Request  Overhead 

Request  overhead  changes  drastically  with  the  number  of  disks  involved  in  a  request.  For  example, 
for  RAID  Level  0,  request  overhead  jumps  from  .7  ms  for  individual  reads/writes  to  10.9  ms  for  full  stripe 
reads/writes.  This  drastic  increase  is  a  side  effect  of  running  on  an  idle  system.  Under  normal  loads,  most 
of  this  overhead  is  overlapped  with  queuing  time  and  does  not  noticeably  affect  performance.  In  an  idle 
system,  when  the  first  of  multiple  messages  is  passed  from  the  parent  process  to  a  child  process,  the  mes¬ 
sage  is  immediately  received  and  acted  upon  by  the  child  (since  the  system  is  idle).  As  that  child  processes 
the  VO  request  it  has  just  received,  it  contends  for  the  CPU  with  the  parent  process,  which  is  trying  to  send 
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Figure  7:  Lifetime  of  Requests.  The  lifetime  of  each  type  of  request  is  traced  by  measuring  the  time 
spent  in  various  stages  of  servicing  the  request:  request  overhead,  IO  CPU  time,  disconnect,  synchroniza¬ 
tion,  and  connect. 
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out  the  other  9  requests.  Thus,  while  sending  out  multiple  messages,  the  parent  process  often  has  to  wait 
through  multiple  context  switches,  as  the  child  processes  receive  and  act  upon  their  messages.  In  contrast, 
in  a  non-idle  system,  most  messages  from  the  parent  to  the  child  processes  are  not  acted  upon  immediately 
by  the  children  (since  they  are  usually  in  waiting  for  a  previous  VO).  As  a  result,  the  parent  can  finish 
sending  the  messages  to  the  children  in  a  short  amount  of  time.  For  example,  for  full  stripe  requests  to  a 
non-idle  system,  the  request  overhead  is  approximately  3.5  ms  per  logical  request. 

Request  overhead  also  increases  with  the  number  of  total  disks  in  the  system.  This  is  due  to  the 
increased  message  passing  overhead  with  more  message  passing  channels.  In  general,  this  effect  is  much 
less  pronounced  on  a  non-idle  system.  However,  it  is  true  that  RAID  Level  1’ s  20  disks  require  more  CPU 
power  than  RAID  Level  0’s  10  disks.  By  limiting  the  experiments  to  20  disks  as  discussed  in  Section  5.2, 
we  prevent  this  increased  CPU  demand  from  unfairly  penalizing  the  throughput  per  disk  of  RAID  Level  1. 

8.1.3.  Seek  Optimization 

RAID  Level  1  reads  are  almost  identical  to  RAID  Level  0  reads.  A  key  difference,  however,  is  the 
disconnect  time.  Die  disconnect  time  of  RAID  Uvel  1  is  shorter  because  RAID  Level  1  requests  can 
choose  between  two  disks  which  have  the  same  data.  By  choosing  the  copy  of  the  data  which  results  in  the 
shorter  seek  time,  the  average  disconnect  time  drops  3-4  ms  from  RAID  Level  0.  [Bitton  88] 

8.1.4.  RAID  Level  5  Individual  Writes 

The  RAID  paper  assumed  that  a  RAID  Level  5  individual  write  was  four  equal  disk  accesses. 
Because  the  four  disk  accesses  are  issued  to  two  disks,  each  disk  sees  a  pair  of  requests:  first  a  read  of  the 
current  data  or  parity,  then  a  write  of  the  new  data  or  parity.  The  lifetime  shown  in  Figure  7  focuses  on  one 
of  these  disks,  say  the  data  disk.  Note  the  two  distinct  disk  accesses  in  the  broken  out  trace  of  RAID  Level 
5  individual  writes  in  Figure  7.  For  the  first  disk  access  (the  read),  we  need  to  add  synchronization  because 
we  are  using  two  independent  disks.  However,  RAID  Level  5  individual  writes  are  unique  in  that  two 
disks  that  cooperate  in  one  request  do  not  necessarily  cooperate  in  the  next  request  Thus,  they  could  have 
different  current  head  positions.  Because  of  this,  we  need  to  synchronize  not  only  different  rotations,  but 
also  different  seek  distances.  Just  as  we  synchronized  multiple  rotations  by  taking  their  maximum,  we  syn¬ 
chronize  multiple  seek  +  rotations  by  taking  the  maximum  of  a  number  of  random  variables,  each 
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distxibuted  as  a  seek  +  rotation.  This  adds  approximately  3.6  ms  to  an  average  seek  plus  an  average  rota¬ 
tion. 

For  the  second  disk  access  (the  write),  no  seek  is  needed.  Because  the  disk  has  just  finished  reading 
the  old  data,  the  new  data  can  be  written  without  moving  the  disk  head.  However,  we  do  see  a  full  rotation 
instead  of  an  average  rotation.  Thus,  we  save  an  average  seek  (15  ms)  but  pay  an  extra  half  rotation  (8.3 
ms).  We  refer  to  this  as  RAID  Level  5  saving  a  seek. 

8 2.  Analyzing  a  Saturated  System 

As  discussed  in  Section  6.5,  we  control  the  system  load  by  controlling  the  number  of  outstanding 
logical  request  in  the  system.  Increasing  the  target  response  time  allows  the  system  to  have  more  outstand¬ 
ing  logical  requests  at  a  time.  This  causes  higher  disk  utilization  and  correspondingly  higher  throughput. 
By  varying  the  load,  we  can  graph  absolute  throughput  per  disk  versus  response  time.  Figures  8  show 
these  graphs  for  the  RAID  paper  workloads;  large  reads,  large  writes,  small  reads,  and  small  writes.  As 
before,  large  means  a  full  stripe;  small  means  an  individual  request. 

Note  that  the  minimum  response  times  are  those  discussed  in  Section  8.1.  As  expected,  when  we 
allow  requests  to  have  longer  service  times,  we  see  higher  throughput  Eventually,  when  the  disks  are  fully 
utilized,  increasing  the  response  time  no  longer  increases  the  throughput.  The  RAID  paper  analysis  deals 
with  this  point  of  maximum  throughput.  By  presenting  RAID  Levels  1  and  5’s  maximum  throughput  per 
disk  relative  to  RAID  Level  0’s,  we  can  make  a  direct  comparison  to  the  performance  predicted  in  the 
RAID  paper  (Figure  9). 

Figure  9  shows  that  for  most  workloads,  the  simple  model  in  the  RAID  paper  accurately  predicts  the 
actual  performance  of  real  hardware.  However,  there  are  significant  differences. 

In  RAID  Level  1,  relative  throughput  for  reads  is  higher  than  predicted  by  our  simple  model.  Recall 
that  the  simple  model  assumed  all  disk  accesses  took  a  constant  amount  of  time.  Because  of  seek  optimiza¬ 
tion,  this  assumption  is  no  longer  valid.  We  adjust  the  simple  model  by  defining  relative  throughput  as  the 
total  disk-time  used  by  a  RAID  Level  0  logical  request  divided  by  the  total  disk-time  used  by  the  RAID 
Level  in  question.  When  seen  in  this  light,  we  can  easily  adjust  for  different  access  times.  Due  to  seek 
optimization,  the  disk-time  for  RAID  Level  1  reads  is  4  ms  per  disk  less  than  RAID  Level  0.  This 
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+  -  RAID  Level  0  ° - RAID  Level  1  A  -  RAID  Level  5 
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Figure  8:  Throughput  vs.  Response  Time.  Throughput  is  graphed  as  a  function  of  response  time  target 
for  4  types  of  I/O  requests:  individual  reads  and  writes,  full  stripe  reads  and  writes.  These  graphs  were 
generated  by  keeping  a  fixed  number  of  logical  requests  in  the  queue  and  measuring  the  resulting 
throughput  and  response  time.  The  data  distribution  used  here  is  uniform  aligned. 
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Figure  9:  Comparing  Maximum  Throughput  Against  Simple  Model.  The  measured  maximum 
throughput  per  disk  relative  to  RAID  Level  0  is  compared  against  the  estimates  made  in  the  RAID  paper 
[Patterson  88],  The  only  significant  differences  occur  for  RAID  Level  1  reads,  due  to  seek  optimization, 
and  RAID  Level  5  individual  writes,  due  to  saving  a  seek. 


represents  approximately  10%  of  the  total  disk-time,  so  the  adjusted  simple  model  predicts  a  relative 
throughput  of  110%  for  RAID  Level  1.  Die  measured  relative  throughput  is  dose  to  this  prediction,  rang¬ 
ing  from  112%-  115%. 

A  RAID  Level  5  small  write  causes  two  disks  to  perform  a  seek,  an  average  rotation,  a  full  track 
transfer,  a  full  rotation,  and  a  second  full  track  transfer  (total  72  ms).  Applying  the  adjusted  model  to 
RAID  Level  5  small  writes,  a  the  total  disk-time  is  approximately  72*2  =  144  disk-ms.  The  total  disk-time 
for  RAID  Level  0  small  writes  is  approximately  40.  Thus,  while  the  simple  model  predicts  a  relative 
throughput  of  25%,  the  adjusted  simple  model  predicts  a  relative  throughput  of  40/144  =  28%.  This  agrees 
with  the  measured  performance. 
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8 3.  Maintaining  Equal  Response  Times 

Section  8.2  compared  the  maximum  throughputs  of  different  RAID  Levels.  However,  the  different 
RAID  Levels  reach  maximum  throughput  at  different  response  times.  It  is  unfair  to  compare  RAID  Levels 
with  different  target  response  times.  By  forcing  all  RAID  Levels  to  have  equivalent  response  times,  we 
generate  a  fairer  comparison.  Figure  8  showed  that  throughput  for  all  RAID  Levels  drops  as  the  response 
time  target  decreases.  To  better  understand  how  throughput  changes  for  each  RAID  Level,  we  graph 
throughput  per  disk  versus  response  time  in  a  slightly  different  way.  Instead  of  absolute  throughput  per 
disk,  we  graph  the  percentage  of  each  RAID  Level’s  maximum  throughput.  For  example,  since  RAID 
Level  0’s  maximum  throughput  per  disk  is  .906  MB/s/disk  for  small  writes,  RAID  Level  0  throughput  is 
graphed  as  a  percentage  of  .906  MB/s/disk  in  Figures  10a.  RAID  Level  l’s  maximum  throughput  per  disk 
for  small  writes  is  .438  MB/s,  so  throughput  per  disk  is  graphed  as  a  percentage  of  .438  MB/s  in  Figure 
10a. 

These  response  time  behavior  figures  show  us  what  to  expect  when  we  maintain  equal  response 
times  for  each  RAID  Level.  For  example,  in  Figure  10a,  we  see  that  at  any  response  time  less  than  1000 
ms,  RAID  Level  5  achieves  a  lower  percentage  of  its  maximum  throughput  than  RAID  Level  0.  This  is 
due  to  RAID  Level  5  small  writes  having  long  response  times  as  discussed  in  Section  8.1.4.  Thus,  RAID 
Level  5  s  relative  throughput  (relative  to  RAID  Level  0)  for  small  writes  will  decrease.  In  contrast,  RAID 
Level  1  small  writes  track  RAID  Level  0  small  writes  very  closely  at  all  response  times.  Thus  we  expect 
RAID  Level  1  small  writes  to  maintain  the  same  relative  throughput 

In  the  remainder  of  this  paper,  we  choose  one  specific  response  time  for  each  workload.  Our  method 
for  choosing  that  response  time  is  somewhat  arbitrary.  We  first  measure  the  minimum  response  time  of  a 
RAID  Level  0  (as  in  the  idle  system  in  Section  8.1)  running  a  particular  workload.  The  target  response 
time  for  that  workload  is  then  set  at  four  times  that  minimum  response  time.  To  summarize,  if  90%  of  all 
requests  on  an  idle  RAID  Level  0  return  in  time  t,  we  control  the  response  time  such  that  90%  of  all 
requests  return  in  time  4*t.  For  full  slripe  requests,  target  response  time  is  268  ms;  for  individual  requests, 
target  response  time  is  200  ms.  This  is  intended  to  allow  some  freedom  to  queue  requests  in  order  to 
achieve  higher  throughput,  but  not  to  allow  queues  to  grow  too  deep.  Notice  that  four  times  the  idle  RAID 
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Figure  10:  Percentage  of  Maximum  Throughput.  Throughput  per  disk  for  each  RAID  Level  is  shown 
as  a  percentage  of  the  maximum  throughput  per  disk  for  that  RAID  Level.  Thus,  we  can  see  the  relative 
effects  of  changing  the  response  time  target  For  example,  in  Figure  10a,  RAID  Level  5  achieves  a  lower 
percentage  of  its  maximum  throughput  than  either  RAID  Level  0  or  1.  Data  distribution  is  uniform 
aligned. 
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Figure  11:  Before  and  After  Equalizing  Response  Times.  Throughput  per  disk  relative  to  RAID  Level  0 
is  shown  before  and  after  maintaining  equal  response  times.  We  see  that  equalizing  to  our  target  response 
times  affects  relative  throughput  for  RAID  Level  1  individual  reads  and  RAID  Level  5  individual  writes. 


Level  0  response  time  for  large  requests  easily  exceeds  the  response  time  needed  to  achieve  maximum 
throughput.  An  interesting  future  experiment  would  be  to  restrict  large  requests  to  a  small  percent  over  the 
minimum  response  time. 

Figure  1 1  shows  the  relative  throughput  per  disk  of  RAID  Levels  1  and  5  before  and  after  equalizing 
to  these  target  response  times.  Note  that  at  the  particular  response  times  we  chose,  only  two  workloads 
show  significant  change  relative  to  RAID  Level  0:  RAID  Level  5  small  writes  and  RAID  Level  1  small 
reads.  We  discussed  previously  how  the  throughput  for  RAID  Level  5  small  writes  changed  as  we  main¬ 
tained  equal  response  times.  Similarly,  Figure  10b  shows  that,  at  our  200  ms  target  response  time,  RAID 
Level  1  has  is  at  a  slightly  higher  percentage  of  its  maximum  throughput 
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This  section  has  focused  on  response  times.  We  have  seen  that  limiting  response  times  causes  less 
than  maximum  throughput  for  all  RAID  Levels.  In  general,  RAID  Levels  with  longer  response  times  are 
penalized  more  than  RAID  Levels  with  shorter  response  times. 

9.  More  Realistic  Workloads 

In  Section  8,  we  analyzed  the  RAID  paper  workload  of  full  stripe  or  individual  requests,  100%  reads 
or  100%  writes.  We  started  by  analyzing  idle  systems  (minimum  response  time)  and  saturated  systems 
(maximum  throughput).  We  finished  by  analyzing  systems  with  equivalent  response  times.  While  still 
maintaining  equivalent  response  times,  we  now  begin  modifying  the  actual  workload:  request  size,  data 
distribution,  and  read/write  ratio. 

9.1.  Distributing  Request  Sizes 

A  key  characteristic  of  any  workload  is  the  logical  requests  sizes.  Until  now,  large  requests  have 
been  full  stripe  requests  and  small  requests  have  been  individual  requests.  Thus,  with  10  disks  and  track- 
level  striping,  large  requests  have  been  exactly  400  KB  and  individual  requests  have  been  exactly  40  KB. 
However,  in  real-world  systems,  large  requests  are  often  much  larger  than  400  KB  [Bucher  80]  and  small 
requests  are  often  much  smaller  than  40  KB  [Ousterhout  85,  Anon  85].  Also,  applications  rarely  issue 
requests  that  are  all  the  same  size.  Rather,  they  issue  requests  of  various  sizes.  We  therefore  make  two 
changes  to  the  request  size  distribution: 

(1)  We  no  longer  restrict  the  workloads  to  one  particular  size.  Rather,  we  use  a  distribution  of  request 
sizes.  For  large  requests,  we  generate  request  sizes  derived  from  a  normal  distribution;  for  small 
requests,  we  generate  request  sizes  based  on  an  exponential  distribution. 

(2)  We  change  the  average  size  of  both  large  and  small  requests:  an  average  large  request  changes 
from  400  KB  to  1.5  MB  (approximately  4  stripes);  an  average  small  request  changes  from  40  KB  to 
6  KB,  the  closest  we  could  come  to  one  4KB  sector. 

Thus,  the  large  requests  get  larger  and  the  small  requests,  get  smaller.  This  significant  change  will 
alter  many  of  our  results;  qualitatively,  however,  what  we  have  learned  so  far  will  still  hold.  Seek  optimi¬ 
zation  will  continue  to  benefit  RAID  Level  1  reads;  RAID  Level  5  small  writes  will  still  save  a  seek. 
Changes  to  our  target  response  times  will  follow  the  changes  in  RAID  Level  0  minimum  response  times 
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011  RAID  Level  0 


Before  distributing  request  sizes 
R,W:  request  size  =  full  stripe  =  400  KB 
r,w:  request  size  =  individual  =  40  KB 


After  distributing  request  sizes 
R,W:  request  size  =  normal  distribution,  mean  1.5  MB 
r,w:  request  size  =  exponential,  mean  6  KB 


Figure  12:  Effect  on  Absolute  Throughput  Of  Changing  Request  Sizes.  Throughput  after  distributing 
request  sizes  is  shown  as  a  percentage  of  the  throughput  before  distributing  request  sizes.  Throughput  for 
large  requests  improved  to  about  160%;  throughput  for  small  requests  decreased  to  about  25%  of  the  undis¬ 
tributed  request  sizes. 


(new  response  time  target  for  large  requests  will  be  780  ms;  new  response  time  target  for  small  requests 
will  be  148  ms). 

Because  large  requests  using  our  new  size  distributions  will  usually  cover  multiple  stripes,  each  disk 
transfers  more  information  per  seek  than  before  and  absolute  throughput  will  increase  for  all  RAID  Levels. 
In  contrast,  because  small  requests  are  smaller  on  average,  less  data  is  transferred  per  seek  and  absolute 
throughput  for  small  requests  will  decrease  for  all  RAID  Levels.  These  trends  in  absolute  throughput  are 
shown  in  Figure  12,  which  shows  throughput  after  distributing  request  sizes  as  a  percentage  of  the 
throughput  before  distributing  request  sizes. 


t 
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The  same  general  trends  hold  for  all  RAID  Levels:  throughput  increases  for  large  requests  and 
decreases  for  small  requests.  However,  there  is  some  variation  in  how  much  each  RAID  Level  changes. 
To  better  picture  how  the  performance  of  RAID  Levels  1  and  5  change  relative  to  RAID  Level  0,  we  plot 
the  new  relative  throughput  per  disk.  We  show  the  relative  throughput  before  and  after  we  distribute  and 
change  the  means  of  the  request  sizes.  The  following  four  subsections  discuss  these  results,  shown  in  Fig¬ 
ure  13. 


After  distributing  request  sizes 

R,W:  request  size  =  normal  distribution,  mean  1 .5  MB 
r,w:  request  size  =  exponential,  mean  6  KB 


Figure  13:  Relative  Throughput  Before  and  After  Changing  Request  Sizes.  In  this  figure,  we  see  how 
the  throughput  of  RAID  Levels  1  and  5  change  relative  to  RAID  Level  0  as  request  sizes  are  distributed. 
Distributing  the  request  sizes  decreased  the  relative  throughput  per  disk  for  RAID  Level  1  large  reads  due 
to  the  lessening  importance  of  seek  optimization.  RAID  Level  5  large  reads  decreased  in  relative 
throughput  due  to  reading  the  parity  tracks.  RAID  Level  5  large  writes  decreased  in  relative  throughput 
due  to  the  presence  of  partial  stripe  writes.  RAID  Level  5  small  writes  increased  in  relative  throughput  due 
to  a  different  response  time  target.  Data  distribution  is  uniform  aligned. 
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9.1.1.  RAID  Level  1 

With  larger  requests,  each  disk  access  takes  longer.  Because  of  this,  savings  due  to  seek  optimiza¬ 
tion  are  a  smaller  fraction  of  the  access  time  of  each  disk.  Thus,  RAID  Level  1  large  reads,  which  benefit 
from  seek  optimization,  show  less  performance  advantage  over  RAID  Level  0.  However,  we  do  expect 
RAID  Level  1  to  still  have  slightly  higher  throughput  per  disk  than  RAID  Level  0.  Unfortunately,  the 
request  overhead  for  RAID  Level  1  is  3-4  ms  higher  than  for  RAID  Level  0.  This  cancels  out  the  slight 
performance  advantage  of  seek  optimization,  and  makes  RAID  Level  1  throughput  for  large  reads  equal  to 
RAID  Level  0. 

With  the  other  workloads,  large  writes,  small  reads,  and  small  writes,  the  relative  throughput  of 
RAID  Level  1  turns  out  to  be  the  same. 

9.1.2.  RAID  Level  5  Small  Writes 

As  shown  in  Figure  13,  RAID  Level  5  small  writes  improve  in  relative  throughput  per  disk.  Two 
factors  combine  to  cause  this  improvement: 

First,  by  saving  a  seek  on  the  data  and  parity  write,  we  save  a  fixed  amount  of  time.  With  smaller 
requests,  the  total  request  time  is  shorter  and  this  seek  savings  is  a  slightly  larger  fraction  of  the  entire 
request  time.  This  larger  seek  savings  accounts  for  1%  of  the  6%  change  we  see  in  Figure  13. 

Most  of  the  improved  relative  throughput  is  due  to  selecting  a  response  time  target  which  is  more 
favorable  for  RAID  Level  5  small  writes  than  the  response  time  target  for  undistributed  request  sizes.  Fig¬ 
ure  14  is  similar  to  Figure  10a  characterizing  the  throughput/response-time  profile  for  small  writes.  In  Fig¬ 
ure  10a,  throughput  at  the  target  response  time  (200  ms)  was  at  59%  of  maximum  throughput  for  RAID 
Level  5  and  81%  for  RAID  Level  0.  In  Figure  14,  throughput  at  the  target  response  time  (148  ms)  remains 
roughly  the  same  for  RAID  Level  0  (85%);  However,  RAID  Level  5  at  this  response  time  is  closer  to  its 
maximum  throughput  (72%)  than  before.  As  a  result,  RAID  Level  5’s  relative  throughput  is  higher  than  in 


Section  8.3. 
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Figure  14;  Percent  of  Maximum  Throughput  for  Small  Writes.  Similar  to  Figure  10,  throughput  per 
disk  for  each  RAID  Level  is  shown  as  a  percentage  of  the  maximum  throughput  per  disk  for  that  RAID 
Level.  Size  distribution  is  exponential  with  a  mean  of  6  KB.  Note  that  the  target  response  time  of  148  ms 
is  more  favorable  for  RAID  Level  5  than  the  target  response  time  in  Figure  10a.  Data  distribution  is  uni¬ 
form  aligned. 


9.1.3.  RAID  Level  5  Large  Reads 

For  full  stripe  reads,  the  relative  throughput  of  RAID  Level  5  was  100%.  This  result  was  expected, 
as  no  extra  redundant  information  needed  to  be  read  in,  and  the  number  of  disk  accesses  in  the  physical 
request  equaled  the  number  of  disk  accesses  in  the  logical  request.  However,  now  that  requests  cover  mul¬ 
tiple  stripes,  we  can  no  longer  simply  read  the  data  and  ignore  parity.  For  example,  in  Figure  lb,  if  the  log¬ 
ical  request  reads  logical  tracks  0-13,  disk  1  must  read  its  physical  tracks  0,  2,  and  3.  Because  the  experi¬ 
ment  is  run  in  user-level,  we  do  not  have  control  of  the  channel  program.  Rather,  because  physical  tracks 
0,  2,  and  3  are  not  contiguous,  we  must  issue  two  separate  l/O’s  to  disk  1.  First,  read  physical  track  0. 
Second,  read  physical  track  2-3.  Unfortunately,  by  the  time  the  child  process  is  able  to  complete  the  first 
I/O  and  issue  the  second  I/O,  the  disk  has  rotated  enough  to  miss  the  start  of  track  2.  Thus,  issuing  two 
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1/0  s  in  order  to  skip  over  the  parity  track  costs  a  full  rotation,  the  same  as  simply  reading  the  parity  track 
and  issuing  one  large  I/O. 

An  average  size  (4  full  stripes,  or  40  tracks)  request  will  need  to  skip  over  two  parity  tracks.  The 
overhead,  then,  is  2/40  or  5%.  This  accounts  for  the  5%  drop  in  throughput  shown  in  Figure  13. 

With  tighter  control  of  the  channel  program,  we  could  build  one  channel  program  to  issue  multiple 
I/O’s.  This  would  save  on  turnaround  time  between  the  two  I/O’s  and  prevent  the  missed  revolution. 
Another  solution  is  to  map  the  data  such  that  the  first  data  sector  on  a  track  after  a  parity  track  starts  several 
sectors  past  the  previous  d ata  sector. 

9.1.4.  RAID  Level  5  Large  Writes 

For  writes  which  exacdy  cover  a  number  of  full  stripes,  performance  is  straightforward.  To  maintain 
the  parity  information,  one  parity  track  must  be  written  for  every  10  data  tracks.  Full  stripe  writes  do  not 
need  to  read  any  information.  However,  when  request  sizes  become  distributed,  most  requests  will  not 
cover  an  exact  number  of  full  stripes.  Usually,  one  or  both  ends  of  the  request  will  be  a  partial  stripe.  For 
example,  in  Figure  lb,  if  a  logical  request  covers  logical  tracks  0-13,  stripes  0, 1,  and  2  are  full  stripe  writes 
but  stripe  3  is  only  partially  written  (logical  tracks  12  and  13).  Thus,  although  stripes  0-2  act  as  full  stripe 

writes  with  relative  throughput  4- ,  stripe  3  acts  as  a  partial  stripe  write.  As  discussed  in  Section  6.4, 
partial  stripe  writes  can  have  relative  performance  ranging  from  25%  to  . 

In  this  section,  we  allow  at  most  one  partial  stripe  per  request  This  is  done  by  using  the  uniform 
aligned  data  distribution  (see  Section  6.6).  With  this  data  distribution,  requests  larger  than  one  full  stripe 
are  forced  to  either  begin  or  end  at  a  full  stripe  boundary.  Introducing  one  partial  stripe  per  request  causes 
the  relative  throughput  of  RAID  Level  5  large  writes  to  drop  from  90%  to  80%.  When  we  use  data  distri¬ 
butions  other  than  uniform  aligned  (as  in  the  following  section),  we  see  up  to  two  partial  stripes  per 
request,  and  a  correspondingly  higher  drop  in  relative  throughput 

9.2.  Varying  the  Data  Distribution 

Because  we  interleave  data  across  disks  in  fixed  units,  hot  spots  tend  to  be  spread  among  several 
disks  and  naturally  smoothed  out.  Realistically,  however,  some  disks  will  still  receive  more  requests  than 
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MB  RAID  Level  0 


R,W:  request  size  =  normal  distribution,  mean  1.5  MB 
r,w:  request  size  =  exponential,  mean  6  KB 

Figure  15:  Change  in  Absolute  Throughput  After  Skewing  Data  Distribution.  Throughput  after  skew¬ 
ing  the  data  distribution  is  shown  as  a  percentage  of  the  throughput  before  skewing  the  data  distribution. 
Note  that  skewing  the  data  distribution  has  little  effect  on  throughput  for  large  requests,  whereas 
throughput  for  small  requests  decreases  by  approximately  10%. 


others.  In  this  section,  we  remove  the  assumption  of  uniform  disk  utilization  by  using  a  skewed  data  distri¬ 
bution.  We  continue  to  maintain  equal  response  times.  We  also  continue  to  use  the  most  recent  definitions 
of  large  and  small  requests  (large  is  defined  to  be  a  normal  distribution  of  request  sizes  with  a  mean  of  1.5 
MB;  small  is  defined  to  be  an  exponential  distribution  of  request  sizes  with  a  mean  of  6  KB). 

As  discussed  in  Section  6.6,  skewing  the  data  distribution  reduces  to  choosing  the  starting  location 
(starting  logical  disk  and  starting  stripe)  of  the  logical  request  The  starting  logical  disk  and  the  starting 
stripe  on  that  disk  are  chosen  independently.  In  a  skewed  distribution,  the  starting  disk  is  chosen  according 
to  a  normal,  with  standard  deviation  equal  to  the  number  of  data  disks  (Figure  6).  The  starting  stripe  is 
always  chosen  according  to  a  uniform  distribution  across  all  stripes. 
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Figure  15  shows  the  throughput  after  skewing  the  data  distribution  as  a  percentage  of  the  throughput 
before  skewing  the  data  distribution.  For  all  workloads,  skewing  the  data  distribution  causes  the  absolute 
throughput  to  decrease.  In  most  cases,  the  throughput  for  large  requests  only  decreases  a  few  percent. 
Because  large  requests  cover  multiple  stripes,  choosing  the  starting  disk  of  the  request  generally  has  little 
effect  on  overall  throughput.  An  exception  to  this  is  RAID  Level  5  large  writes  (discussed  below),  whose 
throughput  decreases  more  than  RAID  Levels  0  or  1.  Small  requests  show  a  larger  (10%)  decrease  in 
throughput.  An  exception  is  again  RAID  Level  5,  whose  throughput  decreases  only  slightly. 
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R,W:  request  size  =  normal  distribution,  mean  1.5  MB 
r,w:  request  size  =  exponential,  mean  6  KB 


Figure  16:  Relative  Throughput  Before  and  After  Skewing  the  Data  Distribution.  This  graph  shows 
the  effect  of  skewing  the  data  distribution  on  relative  throughput.  The  data  distribution  was  changed  from 
uniform  aligned  to  skewed.  RAID  Level  5  small  reads  improved  slightly  due  to  the  location  of  the  parity 
tracks.  RAID  Level  5  large  writes  degraded  due  to  additional  partial  stripe  writes. 
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RAID  Level  5  large  write  throughput  decreases  significantly  because  of  additional  partial  stripe 
writes.  When  distributing  the  request  sizes,  a  number  of  partial  stripe  writes  were  introduced.  Using  the 
uniform  aligned  data  distribution,  each  request  had  at  most  one  partial  stripe.  Now,  with  the  skewed  data 
distribution,  no  attempt  is  made  to  align  the  request  on  a  full  stripe  boundary.  Thus,  up  to  two  partial  stnpe 
writes  can  occur  per  request  and  throughput  decreases  accordingly. 

For  small  requests,  the  general  trend  when  skewing  the  data  distribution  is  a  decrease  in  throughput 
of  10%.  However,  RAID  Level  5  throughput  stays  relatively  constant  There  are  several  reasons  for  this 

difference. 

First,  the  skew  of  the  data  distribution  is  done  on  the  logical  disk.  In  RAID  Level  0  the  logical  disk 
is  identical  to  the  physical  disk.  In  RAID  Level  1  the  logical  disk  maps  to  one  or  both  of  two  physical 
disks,  independent  of  which  stripe  is  accessed.  However,  for  RAID  Level  5,  a  logical  disk  does  not  map 
into  a  single  physical  disk.  Rather,  the  mapping  from  logical  disk  to  physical  disk  depends  on  which  stripe 
is  accessed.  For  example,  in  Figure  lb,  logical  disk  0  (stripes  0,  4,  8,  etc.)  is  spread  over  physical  disks  0 
and  1 .  Thus,  the  skew  on  the  data  distribution  is  smoothed  over  by  the  logical  to  physical  mapping  done  by 
RAID  Level  5.  This  lessens  the  effect  of  skewing  the  data  distribution  for  both  RAID  Level  5  small  reads 

and  small  writes. 

For  RAID  Level  5  small  writes,  the  skewed  data  distribution  is  further  smoothed  because  two  disks 
are  involved  in  each  request  Recall  that  the  starting  stripe  is  always  chosen  uniformly  over  all  stripes. 
Thus,  although  the  choice  of  the  data  disk  is  non-uniform,  the  choice  of  the  parity  disk,  which  depends  on 
both  the  starting  disk  and  the  starting  stripe,  is  uniform  over  all  disks.  Having  the  parity  disk  uniformly 
chosen  from  all  disks  again  smooths  the  skew  on  the  disks. 

We  again  plot  the  relative  throughput  for  each  RAID  Level,  both  with  and  without  the  data  distribu¬ 
tion  skewing  (Figure  16). 

93.  Mixing  Reads  and  Writes 

Many  different  types  of  workloads  exist  in  the  real  world.  Very  few,  if  any,  are  100%  reads  or 
writes.  We  have  used  100%  reads  or  writes  to  better  understand  how  varying  other  workload  parameters 
affects  performance.  Now,  keeping  equalized  response  times,  distributed  request  sizes,  and  skewed  data 
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distributions,  we  at  last  mix  reads  and  writes. 

At  first  thought,  we  may  expect  the  throughput  for  RAID  Levels  1  and  5  to  be  the  weighted  average 
of  the  throughputs  for  100%  reads  and  100%  writes.  This  would  cause  linear  variation  in  Figure  17. 
Instead,  though  close  to  linear,  throughput  changes  superiinearly  with  the  fraction  of  reads  in  the  workload. 
To  understand  why  throughput  is  superlinear,  consider  an  idle  system  receiving  a  stream  of  read  or  write 
requests.  Assume  reads  have  a  response  time  of  R  and  writes  have  a  response  time  of  W.  Estimating 
throughput  as  the  reciprocal  of  the  average  response  time,  the  throughput  for  100%  reads  is  |  and  the 

throughput  for  100%  writes  is  A  mix  of  50%  reads  and  50%  writes  will  not  have  a  throughput  that  is 
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the  weighted  average  between  reads  and  writes,  i.e. 


_L+J_ 

R  +  W 


,  Rather,  because  the  average  response 


time  is  ,  the  throughput  of  the  system  should  be  ^  Estimating  throughput  as  the  average  of  the 

constituent  throughputs  (averaging  the  reciprocal  of  the  response  times)  will  always  be  higher  than  the 
actual  throughput  (the  reciprocal  of  the  average  response  time).  Thus,  a  graph  of  throughput  against  frac¬ 
tion  of  reads  will  be  superlinear  . 


9.4.  Summary  of  More  Realistic  Workloads 

To  summarize,  we  look  at  Figures  17.  Note  that  for  small  requests,  RAID  Level  1  consistently  yields 
higher  throughput  per  disk  than  RAID  5.  In  fact,  with  over  90%  reads,  seek  optimization  allows  RAID 
Level  1  to  yield  higher  throughput  per  disk  than  even  RAID  Level  0. 

In  contrast,  for  large  requests,  RAID  Level  5  almost  always  performs  better  than  RAID  Level  1 . 
From  0%  reads  to  almost  95%  reads,  RAID  Level  5  yields  higher  throughput  per  disk  than  RAID  Level  1. 


10.  Additional  issues 

In  this  section,  we  explore  additional  issues,  such  as  further  varying  the  request  size  distribution, 
varying  the  unit  of  interleaving,  and  scaling  the  number  of  disks.  Unless  otherwise  stated,  we  define  large 
as  a  normal  distribution  with  mean  1.5  MB  and  smali  as  an  exponential  distribution  with  mean  6  KB.  We 
also  continue  to  equalize  response  times  and  skew  the  data  distribution.  A  major  change  from  the  previous 
section  is  that  we  now  define  the  read  workload  to  be  a  mixture  of  90%  reads  and  10%  writes;  similarly,  we 
now  define  the  write  workload  to  be  a  mixture  of  90%  writes  and  10%  reads. 


10.1.  Varying  the  Request  Sizes 

In  Section  9.1,  we  both  distributed  the  request  sizes  and  changed  the  mean.  In  this  section,  we  con¬ 
tinue  to  change  the  mean  of  the  request  size  distribution  by  using  various  normal  distributions. 

Figure  18  graphs  the  relative  throughput  for  RAID  Levels  1  and  5  against  average  request  size.  In 
Figure  18a,  RAID  Level  1  relative  throughput  for  writes  is  approximately  50%  for  all  sizes,  as  expected. 
In  contrast,  relative  throughput  for  RAID  Level  5  writes  increases  as  request  size  increases.  As  requests 
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RAID  Level  0  D - RAID  Level  1  A  -  RAID  Levels 


Througfaput/Dick 
Relative  to 
RAID  Level  0 


Average  Request  Size  (MB) 


0.0  0.5  1.0  1.5  2.0  25  3.0 

Average  Request  Size  (MB) 


(a)  90%  writes 


(b)  90%  reads 


Figure  18:  Effect  of  Varying  the  Average  Request  Size.  These  graphs  show  the  relative  throughput  per 
disk  of  RAID  Levels  1  and  5  as  a  function  of  average  request  size.  In  general,  the  relative  throughput  of 
RAID  Level  5  increases  with  increasing  request  size,  whereas  the  relative  throughput  for  RAID  Level  1 
changes  very  little  with  request  size.  Data  distribution  is  skewed. 


become  larger  and  cover  more  full  stripes,  RAID  Level  5  becomes  dominated  by  full  stripe  write  perfor¬ 
mance  rather  than  the  partial  stripe  write  performance  and  relative  throughput  approaches  — -k  Below  .5 

MB,  RAID  Level  1  has  higher  throughput  per  disk  than  RAID  Level  5;  at  sizes  larger  than  .5  MB,  RAID 
Level  5  yields  higher  throughput  per  disk  than  RAID  Level  1. 

In  Figure  18b,  RAID  Level  1  relative  throughput  for  reads  decreases  with  increasing  request  size. 
With  small  requests,  seek  optimization  pushes  RAID  Level  1  relative  throughput  above  100%.  As  requests 
get  larger  and  response  time  increases,  the  benefit  of  seek  optimization  is  minimized.  Relative  throughput 
then  drops  to  90%.  The  10%  writes  in  the  workload  cause  the  total  relative  throughput  to  be  less  than  the 
read  performance  in  Section  9.2  (120%  for  small  requests,  100%  for  large  requests). 

For  RAID  Level  5,  relative  throughput  is  85%  for  small  request  sizes,  then  increases  to  90%-95%  as 
request  sizes  increase.  This  effect  is  due  almost  entirely  to  the  10%  writes  in  the  workload.  For  small 
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request  sizes,  writes  have  a  relative  throughput  of  20%-25%.  However,  at  larger  request  sizes,  the  relative 
throughput  of  writes  is  70%-80%,  so  relative  throughput  increases. 

10.2.  Sector  Striping  vs.  Track  Striping 

Up  to  now,  we  have  always  used  track  striping.  In  this  section,  we  explore  sector  level  striping.  We 
address  two  questions: 

•  Is  it  possible  to  analyze  RAID  Level  1  and  5  independent  of  the  unit  of  interleaving? 


Throughput/Disk 
Relative  to 
RAID  Level  0 


R,W:  request  size  =  normal  distribution,  mean  1.5  MB 
r,w;  request  size  =  exponential,  mean  6  KB 


Figure  19:  Relative  Throughput  for  Track  and  Sector  Striping.  Relative  throughput  per  disk  with  sec¬ 
tor  striping  is  compared  against  the  relative  throughput  per  disk  with  track  striping.  We  see  that  using  sec¬ 
tor  striping  only  affects  relative  throughput  for  RAID  Level  5  writes.  The  response  time  target  for  small 
requests  is  148  ms;  the  response  time  target  for  large  requests  is  780  ms.  The  read  workload  is  90%  reads 
and  10%  writes;  the  write  workload  is  90%  writes  and  10%  reads.  Data  distribution  is  skewed. 
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•  Which  unit  of  interleaving  gives  the  best  absolute  throughput? 

The  RAID  paper  analysis  was  independent  of  the  unit  of  interleaving.  Dependence  from  unit  of 
interleaving,  as  well  as  from  factors  such  as  hardware  specifications,  was  eliminated  partly  by  evaluating 
the  throughput  relative  to  RAID  Level  0.  Also,  the  analysis  achieved  independence  from  the  unit  of  inter¬ 
leaving  by  basing-  the  analysis  on  full  stripe  or  individual  requests.  These  request  sizes  scaled  with  the  unit 
of  interleaving.  In  our  experiment,  we  fix  the  request  size  distribution  independent  of  the  unit  of  interleav¬ 
ing  to  learn  if  identical  workloads  can  be  analyzed  without  regard  for  the  unit  of  interleaving.  Figure  19 
shows  the  relative  throughput  for  RAID  Levels  1  and  5  for  various  sizes  with  90%  writes  and  90%  reads. 


(H  RAID  Level  0 


R,W:  request  size  =  normal  distribution,  mean  1 .5  MB 
r,w:  request  size  =  exponential,  mean  6  KB 


Figure  20:  Change  in  Absolute  Throughput  after  Changing  from  Track  to  Sector  Striping. 
Throughput  with  sector  striping  is  shown  as  a  percentage  of  the  throughput  with  track  striping.  Throughput 
with  track  striping  is  generally  better  than  throughput  with  sector  striping.  An  exception  to  this  is  RAID 
Level  5  large  writes.  The  reads  workload  is  90%  reads  and  10%  writes;  the  write  workload  is  90%  writes 
and  10%  reads.  Data  distribution  is  skewed. 
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For  RAID  Level  1 ,  relative  throughput  with  sector  striping  is  close  to  relative  throughput  with  track  strip¬ 
ing.  Similarly,  for  RAID  Level  5  reads,  relative  throughput  with  sector  striping  closely  matches  relative 
throughput  with  sector  striping.  However,  for  RAID  Level  5  writes,  the  relative  throughput  changes  with 
the  unit  of  interleaving.  Thus,  although  analysis  for  RAID  Level  1  and  RAID  Level  5  reads  can  be  done 
with  little  regard  to  unit  of  interleaving,  the  analysis  for  RAID  Level  5  writes  should  take  into  account  the 
unit  of  interleaving. 

To  compare  sector  striping  to  track  striping  in  terms  of  absolute  throughput,  we  show  throughput 
with  sector  striping  as  a  percentage  of  throughput  with  track  striping  (Figure  20).  The  general  trend  in  Fig¬ 
ure  20  is  that  changing  from  track  to  sector  striping  causes  throughput  to  decrease.  This  decrease  is  more 
pronounced  for  small  requests  than  for  large  requests.  For  very  small  requests  (single  sector),  the  disks  see 
the  same  stream  of  physical  requests  using  either  sector  striping  or  track  striping.  Slightly  larger  requests 
(larger  than  a  sector  but  less  than  a  track)  are  mapped  onto  multiple  disks  with  sector  striping  but  onto  a 
single  disk  with  track  striping.  Thus,  in  track  striping,  the  single  disk  is  transferring  more  data  per  seek 
than  the  multiple  disks  are  in  sector  striping.  This  causes  lower  throughput  with  sector  striping.  With 
extremely  large  requests  (more  than  10  tracks),  both  sector  striping  and  track  striping  cause  disks  to 
transfer  the  same  amount  of  information,  leading  to  roughly  the  same  throughput. 

The  sole  exception  to  this  trend  in  changing  from  track  to  sector  striping  is  RAID  Level  5  writes. 
The  trend  of  decreased  throughput  with  sector  striping  was  caused  by  spreading  a  request  over  more  disks, 
with  each  disk  transferring  less  data.  However,  RAID  Level  5  writes  benefit  by  using  more  disks  in  servic¬ 
ing  a  request.  Relative  throughput  for  partial  stripe  writes  ranges  from  25%  for  single  disk  partial  stripe 

writes  to  for  wider  (many  disks)  partial  stripe  writes.  Thus,  spreading  requests  over  more  disks  leads 

to  wider  partial  stripes  and  higher  relative  throughput.  This  can  offset  the  performance  degradation  caused 
by  having  each  disk  transfer  less  data.  With  very  large  requests,  throughput  also  increases  because  the  par¬ 
tial  stripe  portion  of  the  request  will  be  a  lesser  fraction  of  the  total  request 

10.3.  Scaling  the  Number  of  Disks 

So  far  in  this  paper,  we  have  limited  the  maximum  number  of  total  disks  to  20.  All  RAID  Levels 
have  used  10  data  disks,  with  RAID  Level  1  using  20  total  disks  and  RAID  Level  5  using  1 1  total  disks.  In 
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this  section,  we  explore  what  happens  as  we  vary  the  number  of  data  disks  used. 

Figures  scale  shows  how  the  throughput  per  disk  varies  as  we  vary  the  number  of  data  disks.  We 
continue  to  use  a  target  response  time  of  four  times  the  response  time  of  an  idle  RAID  Level  0  system.  We 
also  continue  to  define  small  as  an  exponential  distribution  with  mean  6  KB.  However,  we  change  our 
definition  of  a  large  request.  With  10  data  disks,  our  previous  definition  of  a  large  request  (normal  with 
mean  1.5  MB)  covered  an  average  of  4  stripes.  Thus,  each  disk  transferred  4  tracks  per  seek.  However, 
with  more  data  disks,  this  average  sized  request  no  longer  covers  4  stripes.  To  compensate,  we  scale  the 
size  of  an  average  request  along  with  the  number  of  disks.  We  maintain  an  average  request  size  of  150 
KB/data  disk.  For  example,  with  20  data  disks,  we  use  an  average  request  size  of  3  MB.  With  this 
modification,  an  average  large  request  will  continue  to  cause  each  disk  to  transfer  approximately  4  tracks. 

In  general,  throughput  per  disk  is  approximately  constant,  showing  that  it  is  independent  of  the 
number  of  data  disks.  An  important  exception  occurs  when  the  total  number  of  disks  exceeds  20.  For 
example,  a  RAID  Level  I  system  with  15  data  disk  (30  total  disks)  shows  a  dramatic  drop  in  throughput 
per  disk.  As  discussed  in  Section  5.2,  this  drop  in  throughput  per  disk  comes  from  not  scaling  the  CPU 
power  along  with  the  number  of  disks.  With  more  than  20  disks,  the  CPU  begins  to  limit  performance  and 
maintaining  constant  throughput  per  disk  becomes  impossible  without  more  CPU  power. 

We  also  see  that  the  throughput  per  disk  of  RAID  Level  5  large  writes  (Figure  21c)  increases  slightly 
with  more  data  disks.  This  is  because  there  is  always  one  parity  disk  per  system,  and,  with  more  data  disks 
in  the  system,  the  overhead  of  updating  this  parity  disk  affects  overall  system  performance  less.  Thus, 
throughput  per  disk  increases. 

10.4.  Multiple  Disks  per  Channel  Path 

We  have,  so  far,  connected  one  disk  per  channel  path  (Figure  4).  When  a  disk  is  ready  to  transfer 
information,  no  channel  conflicts  are  possible.  With  more  than  one  disk  is  connected  to  a  channel  path, 
(Figure  22)  channel  conflicts  are  possible  [Ng  88].  These  channel  conflicts  delay  the  disk  from  transferring 
data  and  cause  the  disk  to  miss  a  rotation  (an  RPS  miss).  Figure  23  shows  the  effect  of  connecting  multiple 
(one  or  two)  disks  per  channel  path,  by  showing  throughput  with  multiple  disks  per  channel  path  as  a  frac¬ 
tion  of  throughput  with  one  disk  per  channel  path. 
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+  —  raid  Level  0  D - RAID  Level  1  A  RAID  Level  5 


Throughput 
per  disk 
(MB/s/disk) 


(a)  small,  90%  writes 


(b)  small,  90%  reads 


(c)  large,  90%  writes  (d)  large,  90%  reads 

Figure  21:  How  RAID’s  Scale.  Throughput  per  disk  is  shown  as  a  function  of  the  number  of  data  disks. 
In  general,  throughput  per  disk  is  constant  under  20  total  disks.  The  size  distribution  for  large  requests  is  a 
normal  with  a  mean  of  150  KB  per  data  disk.  The  size  distribution  for  small  requests  is  an  exponential 
with  a  mean  of  4  KB.  Response  time  target  for  small  requests  (for  all  numbers  of  disks)  is  148  ms. 
Response  time  target  for  large  requests:  5  data  disks:  720  ms,  10  data  disks:  780  ms,  15  data  disks:  876  ms, 
20  data  disks:  924  ms.  Data  distribution  is  skewed. 
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Figure  22:  Architecture  with  Multiple  Disks  per  Channel  Path.  This  figure  shows  how  multiple  disks 
per  channel  are  connected  to  the  memory  bus  for  Section  10.4.  Strings  of  four  disks  are  shared  between 
two  paths  to  the  memory  bus. 
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ED  RAID  Level  0 


R,W:  request  size  =  normal  distribution,  mean  1.5  MB 


r,w:  request  size  =  exponential,  mean  6  KB 


Figure  23:  Change  in  Absolute  Throughput  after  Connecting  Multiple  Disks  per  Channel  Path. 
Throughput  with  multiple  disks  per  channel  path  is  shown  as  a  percentage  of  throughput  with  one  disk  per 
channel  path.  Throughput  for  large  request  sizes  drops  to  half  the  throughput  with  one  disk  per  channel 
path,  whereas  throughput  for  small  requests  only  decreases  10%. 


Two  channel  paths  are  connected  to  one  string  of  four  disks.  We  represent  a  string  by  letters  and  the 
disks  on  a  string  by  numbers  (e.g.  disks  aO,  al,  a2,  a3  make  up  one  string).  RAID  Levels  0  and  5  have  a 
straightforward  mapping:  disks  0-10  are  a(l-a3,  b0-b3,  c0-c2.  Thus,  RAID  Levels  0  and  5  have  10  or  11 
disks  with  6  channel  paths  total.  RAID  Level  1  has  the  following  mapping:  the  primary  data  disks  are  aO- 
a3,  b0-b3,  cO-cl;  the  shadow  disks  are  c2-c3,  d0-d3,  e0-e3. 

Throughput  for  large  requests  drops  to  50%-55%  of  the  throughput  with  one  disk  per  channel. 
Because  each  disk  is  transferring  an  average  of  4  tracks  per  request,  the  channel  is  often  busy.  Sharing  a 
busy  channel  causes  a  severe  drop  in  throughput  Small  requests,  on  the  other  hand,  only  drop  in 
throughput  by  10%-15%.  Because  very  little  time  in  a  small  request  is  spent  transferring  data  (and  thus 
tying  up  a  channel  path),  little  potential  for  channel  conflicts  exist  and  little  penalty  is  seen. 
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11.  Summary 

We  have  started  with  a  simple  model  for  performance  and,  step  by  step,  measured  performance  with 
more  and  more  realistic  experiments.  We  first  measured  maximum  throughput  using  the  RAID  paper 
workload  of  100%  reads  or  writes,  individual  or  full  stripe  requests.  We  found  that  the  simple  model  accu¬ 
rately  predicted  performance  for  most  cases.  The  main  exception  was  RAID  Level  1  reads,  where  seek 
optimization  causes  higher  than  expected  throughput 

Second,  we  equalized  response  times.  We  found  that  equalizing  response  times  hurt  the  relative 
throughput  of  RAID  Levels  with  higher  response  times  (RAID  Level  5  small  writes)  and  helped  the  rela¬ 
tive  throughput  of  RAID  Levels  with  lower  response  times  (RAID  Level  1  small  reads). 

Third,  we  distributed  the  request  sizes  and  made  large  requests  larger  and  small  requests  smaller. 
We  found  that  seek  optimization  ceased  to  noticeably  help  RAID  Level  1  large  reads.  RAID  Level  5  large 
reads  were  penalized  for  skipping  parity  tracks.  RAID  Level  5  large  writes  suffered  from  partial  stripe 
writes.  Even  more  partial  stripe  writes  were  generated  by  allowing  unaligned  requests. 

Fourth,  we  mixed  reads  and  writes.  We  found  that  RAID  Level  5  had  higher  throughput  per  disk 
than  RAID  Level  1  for  large  requests  for  almost  all  mixes  of  reads  and  writes.  In  contrast,  RAID  Level  1 
had  higher  throughput  per  disk  than  RAID  Level  5  for  small  requests  for  all  mixes  reads  and  writes. 

Lastly,  we  explored  issues  such  as  varying  the  request  sizes  and  using  sector  striping.  We  found  that 
track  striping  was  usually  better  than  sector  striping,  with  the  notable  exception  of  RAID  Level  5  large 
writes. 

12.  Future  Work 

We  are  continuing  to  analyze  the  performance  of  disk  arrays.  In  particular,  we  are  interested  in 
arrays  of  small  disks.  We  are  designing,  building,  and  evaluating  a  disk  array  of  30-50  CDC  Wren  disk 
drives.  One  step  in  that  evaluation  will  be  to  carry  out  experiments  similar  to  the  ones  in  this  paper. 
Further  work  will  entail  building  a  file  system  and  running  real  world  benchmarks  on  that  system. 
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fr  14;Z7;30 

The  following  Is  the  data  used  In  this  paper: 

Field  1  (eg.  rO,  rl,  r5}  :  program  used:  rO  -  raidO,  rl  =  raid!,  r5  «  raia5 
Field  2  (eg.  10) :  unit  of  interleaving,  in  4K  sectors 
Field  3  (eg.  t 13) :  code  for  read/write  ratio: 


1 7  - 

90% 

reads 

1 8  - 

10% 

reads 

1 9  - 

100% 

writes 

tio 

=  30% 

reads 

til 

=  .50% 

reads 

tl  2 

-  70% 

reads 

tl2 

=  70% 

reads 

1 13 

=  100%  reads 

Field  4  (eg.  si}:  code  for  request  size  distribution 
si  =  full  stripe 
s2  =  individual 

s3  -  normal  with  mean  300  sectors,  standard  deviation  300  sectors 
s4  -  exponential  with  mean  1  sector 

s8  «  normal  with  mean  450  sectors,  standard  deviation  450  sectors 
sll  =  normal  with  mean  150  sectors,  standard  deviation  150  sectors 
s29  =  normal  with  mean  25  sectors,  standard  deviation  25  sectors 
s31  =  normal  with  mean  100  sectors,  standard  deviation  100  sectors 

s32  -  normal  with  mean  500  sectors,  standard  deviation  500  sectors 

s41  =  normal  with  mean  600  sectors,  standard  deviation  600  sectors 

s42  =  normal  with  mean  192  sectors,  standard  deviation  192  sectors 

Field  5  (eg.  110) ;  code  for  data  distribution 

15=  normal  with  standard  deviation  15  disks 

16  =  normal  with  standard  deviation  10  disks 

17  =  normal  with  standard  deviation  5  disks 

19  =  normal  with  standard  deviation  20  disks 

110  uniform  aligned  data  distribution 

Field  6  (eg.  lat-5,  lat200) :  target  response  time  (for  90%  latency  marks) 
lat-x  =  keep  the  queue  depth  fixed  at  x  outstanding  logical  request 
latxxx  =  target  the  response  time  at  xxx  ms 
Field  7  (eg.  dlO) :  number  of  disks 
Field  8  (eg.  ro3.338):  request  overhead,  in  ms 
Field  9  (eg.  Ia233) :  measured  response  time  (90%  marks) 

Field  10  (eg.  lap. 895):  measured  percentage  of  requests  which  met  the  measured 
response  time 

Field  11  (eg.  latp.81):  measured  percentage  of  requests  which  met  the  target 
response  time 

Field  12  (eg.  Iaav214 . 618) :  measured  average  response  time  in  ms 
Field  13  (eg.  il398) :  number  of  I/O's 

Field  14  (eg.  e0) :  amount  of  CPU  time  spent  in  exclusive  or-ing 

Field  15  (eg.  szlOO) :  measured  average  size  of  request 

Field  16  (eg.  szs.3):  measured  standard  deviation  in  size  of  requests 

Field  17  (eg.  ti60255.4):  total  time  of  run 

Field  18  (eg.  th9. 06298):  throughput  in  MB/s 

Field  19  (eg.  io23.2Q12):  I/O's  per  second 

Field  20  (eg.  ch40.0411):  total  time  per  access  spent  by  child  process 

Field  21  (eg.  chcl. 27629) :  cpu  time  spent  per  access  by  child  process 

Field  22  (eg.  qd5. 01788):  average  queue  depth  over  the  run 

Field  23  (eg.  ssch!3993) :  total  number  of  start  subchannels 

Field  24  (eg.  connl 6 . 1593 ) :  average  connect  time  per  disk  access 

Field  25  (eg.  disc22 . 5913 ) :  average  disconnect  time  per  disk  access 

Field  26  (eg.  pend. 23765):  average  function  pending  time  per  disk  access 

Field  27  (eg.  cpu2912.22):  total  cpu  time 

Field  28  (eg.  u0) :  run  reached  stability  (ul)  or  not  (uO) 


rO  10  t 13  si  110  lat-5  dlO  crO  ro3.338  la233  lap. 899142  latpO  laav214.618  il398  eO  szlOO  szsO  ti60255.4  th9. 06298  io23.2012  ch40.0411  chcl. 27629  qd5. 01788  sschl3993  connl6.1593  di 
sc22 . 5913  pend. 23765  cpu2912.22  uO 

rO  10  t 13  s2  110  lat-120  dlO  crO  ro. 699658  lal040  lap. 899921  latpO  laav508.411  114067  eO  szlO  szsO  ti61022.4  th9. 00477  io23Q.522  ch40.1164  chcl. 26025  qdl21.024  sschl4186  connl6.15 
67  disc22 . 6262  pend. 236519  cpu6704.87  uO 

rl  10  t 13  si  110  lat-10  d20  crl  ro3. 73798  la278  lap. 898718  latpO  laavl91.9B6  13120  eO  szlOO  szsO  ti60251.5  th20.22?7  io51.7829  ch35.663  chcl. 2672  qdl0.0321  ssch31252  connl6.161  di 
scl 8.1206  pend. 23331  cpu6935.06  uO 
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rl  10  t!3  s2  110  lat-240  d20  crl  ro. 819269  1  a 9 S 7  lap. 900025  latpO  laav439.637  132400  eO  szlO  szsO  ti60894.3  th20.784  io532.069  ch35.1774  chcl. 30254  qd241.778  ssch32634  connl6.l588 
dlscl7.5036  pend. 231686  cpul7205.2  uO 

rl  10  19  si  110  lat-5  d20  crl  ro6. 86653  la233  lap. 900358  latpO  laav214.521  11395  eO  szlOO  szsO  ti60226.8  th9. 04784  lo23.1625  ch40.408  chcl. 18748  qd5. 01792  ssch27925  corml6.1441  dl 
SC22.9866  pend. 232784  cpu5761.84  uO 

rl  30  1 9  s2  110  lat-120  d20  crl  rol. 3117  lal083  lap. 89986  latpO  laav51  9.434  113761  eO  szlO  szsO  1161308  tii8. 76785  lo224.457  ch40.3154  chcl. 232  qdl21.046  ssch27716  connl6.146  dlsc2 
2.9276  pend. 23198  cpul0248.5  uO 

r5  10  tl3  si  110  lat-6  dll  cr5  ro3. 12503  la280  lap. 902084  latpO  laav232.613  12063  eO  szlOO  szsO  tl80309.8  thl0.0344  lo25.688  ch39.9428  chcl. 22715  qd6. 01745  ssch20650  connl6.1585  d 
i sc22 . 4777  pend. 233939  cpu4483.73  uO 

r5  10  tl3  s2  110  lat-132  dll  crS  ro. 462504  lall56  lap. 90004  latpO  laavS02.776  115511  eO  szlO  SzsO  C161942.8  th9. 78158  1O250.408  ch40.1741  chcl. 25509  qdl33.123  sschl5643  connl6.156 
9  dlsc22.7096  pend. 232729  cpu5083.76  uO 

r5  10  1 9  si  110  lat-5  dll  cr5  ro4. 00511  la233  lap. 904591  latpO  laav214.B88  11394  e9851.16  szlOO  szsO  tl  60239.1  th9. 0394  9  lo23.1411  ch40.2587  chcl, 31094  qd5. 01793  sschl5359  Connie. 
1568  dl sc22 . 7444  pend. 236465  cpull435.3  uO 

r5  10  1 9  s2  110  lat-66  dll  cr5  rol. 32368  lal720  lap. 699904  latpO  laav924.554  14238  e7368.39  szlO  szsO  ti621  98.1  th2. 66161  io68.1371  ch36.3098  chcl.  49142  qd67.0278  sschl7114  conn!6 
.157  dlscl8.8004  pend. 233734  cpulOOOO  uO 

rO  10  1 13  s3  16  lat 780  dlO  crO  ro3. 64628  la791  lap. 899719  latp. 89597  laavS87.633  11068  eO  SZ37B.290  szs237.106  U100740  thl5.6662  lol0.6015  ch95.0774  chc4.935  qd6. 33708  sschl0093 
conn65,8926  dlse26.0005  pend. 232223  cpu2220.92  uO 

rO  10  tl3  s4  16  lat 148  dlO  crO  ro. 967385  lal45  lap. 899984  latp. 90693  laav70.2815  118736  eO  szl. 57051  szs. 954408  t!77657.5  thl. 48765  lo241.265  ch27.7283  chc. 750901  qdl7.5859  sschl8 
757  conn3. 22694  disc23.7063  pend. 230894  cpul2336.9  uO 

rO  10  1 7  S3  16  lat-1  dlO  crO  ro22.962  lal95  lap. 901484  latpO  laavl21,367  1741  eO  sz377.236  SZS236.316  1190183. 6  thl2.1078  lo8. 21657  ch94.0301  chc4. 04791  qdl. 00135  ssch7042  conn65. 
2686  disc25.6957  pend. 234388  cpul87G.75  uO 

rO  10  t7  s4  16  lat-1  dlO  crO  ro. 654917  la37  lap. 891397  latpO  laav28.36  14208  eO  szl. 60979  szs. 986756  tll20089  th. 220344  lo35.0407  ch27.4328  chc. 827944  qdl. 00024  ssch4208  conn3.277 
6  dlsc23.4084  pend. 231027  cpul752.13  uO 

rl  10  c 13  S3  16  lat780  d20  crl  ro7. 24226  la791  lap. 9  latp. 892  laav497.S26  12505  eO  SZ386.345  SZS236.917  til20939  th31.2591  1020.7129  ch92.7267  chc4. 38754  qdlO.4643  ssch23946  conn6 
6.6342  dlsc22.7589  pend. 231219  cpu5746.27  uO 

rl  10  1 13  s4  16  latl48  d20  crl  rol.  1355  lal47  lap.  899684  latp.  904714  laav77.6468  17021  eO  szl.  56844  szs. 929039  U121U.8  th3. 55154  lo579.662  Ch24.8604  chcl. 4997  qd46.5746  ssch7057 
conn3. 21244  dlsc20.7869  pend. 2297  cpu5322.18  uO 

rl  10  L 9  s3  16  lat780  d20  crl  ro7. 01629  la781  lap. 901395  latp. 901395  laav598.453  11075  eO  52377.98  szs234  .261  til00782  th!5.749  lol0.6665  ch93.6306  chc4. 08376  qd6. 45395  ssch20479 
conn65.5071  dlsc25.3979  pend.231668  cpu4397.09  uO 

rl  10  1 9  s4  16  latl48  d20  crl  ro2. 32932  la!45  lap. 900834  latp. 909178  laav77.3927  135619  eO  szl. 58427  szs. 976633  tU55662  thl. 41608  lo228.823  ch27.7296  chc. 809779  qdl8.3582  ssch712 
78  conn3. 23342  disc:23.6593  pend. 2311  cpu49143.7  uO 

r5  10  t 13  s3  16  lat 780  dll  cr5  ro3. 90841  la777  lap. 900446  latp. 910847  laav596.944  1673  eO  sz375.009  szs234.932  tl60836.9  thl6.205  loll. 0624  ch92.1498  chc5. 94573  qd6. 74294  ssch6941 
conn63.0905  dlsc26.0262  pend. 232192  cpul629.57  uO 

r5  10  t 13  s4  16  lacl48  dll  cr5  ro. 62268  U144  lap. 699541  latp. 907798  laav70.4473  16569  eO  szl. 57695  szs. 992693  L123467  thl. 72433  io279.925  ch27.6905  chc. 923976  qd20.0094  ssch658B 
conn3. 22512  disc23.6798  pend. 230043  cpu2656.72  uO 

r5  10  1 9  s3  16  lat780  dll  cr5  ro8.4284  la794  lap. 90061  latp. 895122  laav576.943  11640  e55562.7  SZ384.684  szs234.527  tl201570  thl2.2259  to8. 13611  ch74.6627  chc3. 42341  qd4. 73171  ssch 
26145  conn50. 4656  dlsc21.6273  pend. 233289  cpu52192.9  uO 

r5  10  1 9  s4  16  latl48  dll  cr5  ro2. 08863  lal46  lap. 900352  latp. 911487  laav89.8798  17095  el330.22  szl.  59239  szs. 974169  tll00253  th. 440214  lo70.7709  ch21.8746  chc.762B37  qd6. 43693  ss 
ch28402  conn3, 24848  dlscl7.8499  pend. 231876  cpu9288.52  uO 

exoi5  10  t7  S3  16  lat-1  dll  cr5  ro25.9009  la210  lap. 900329  latpO  laavl31.116  1913  el916.7  sz398.783  szs235.563  tll20202  thll.8319  lo7. 59554  ch92.9173  chc3.8137  qdl. 0011  ssch9975  c 
onn64 . 538 1  dlsc25.3423  pend. 234545  cpu4452.87  uO 

exor5  1C  t7  s4  16  lat-1  dll  cr5  ro. 897763  la44  lap. 896905  latpO  laav30,S335  13909  e41,319  szl. 6022  szs. 99839  til20050  th. 203789  lo32.5614  ch25.6209  chc. 84496  qdl. 00026  ssch5085  co 
nn3. 27912  disc21.5941  pend. 229318  cpul974.56  uO 

exor5  10  t.8  s3  16  lat-1  dll  cr5  ro23.9128  la227  lap. 90125  latpO  laavl49.626  1800  ell678.6  SZ390.71  szs241.24  t!120188  thlO.1588  lo6. 65624  ch76.6S79  chc3. 34966  qdl. 00125  sschl2276 
conn52. 1922  disc21.8409  pend. 236825  cpul3452.8  uO 

exor5  10  t8  $3  16  lat780  dll  cr5  ro8. 70701  la777  lap. 900277  latp. 907202  laav586.568  1723  ell724.6  SZ399.959  szs226.651  tl90488.2  thl2.4831  lo7.99  ch77.0924  chc5.1264  qd4. 75795  ssc 
hi  1  296  conn52 .4  81  2  disc21.9365  pend. 231581  cpul2522  uO 

exor5  10  t8  s4  16  lat-1  dll  crS  ro2. 71604  la57  lap. 890075  latpO  laav47.8541  11874  el56.493  szl. 57097  szs. 963324  tl90077  th. 127669  io20.8044  ch21.9154  chc. 887377  qdl. 00053  ssch6687 
conn3. 21717  disci?. 9455  pend. 230054  cpu2251.50  uO 

exor5  10  t8  s4  16  latl48  dll  cr5  rol. 92481  lal46  lap.9001BB  latp. 909123  laav87.4918  18509  e701.094  szl. 57751  szs. 96136  tlllll82  th.4716  lo76.532  ch22.0649  chc. 762969  qd6. 86309  ssc 
h 3 1 3 4 6  conn3. 21  652  dlscl8.0731  pend. 231262  cpu9642.41  aO 

exor5n  10  t7  s3  16  lat-1  dll  cr5  ro24.94C4  la208  lap. 899676  latpO  laavl29.292  1927  eO  SZ385.518  szs242.051  tll20344  thll.6001  lo7. 70294  ch90.7976  chc3. 70484  qdl. 00108  sschlQ052  co 
nn62. 9533  dlsc24.B151  pend. 234544  epu2823.8  uO 

exor5n  10  t7  s4  16  lat-1  dll  cr5  ro. 868469  la43  lap. 900776  latpO  laav30.2117  12963  eO  szl. 57138  szs. 939919  U90037.1  th.202  lo32.9087  ch25.6326  chc. 862732  qdl. 00034  ssch3803  conn3 
.2379  dlsc21 .6507  pend. 232642  cpu!443.34  uO 

exor5n  10  t8  s3  16  lat-1  dll  cr5  ro22.3047  la225  lap.  900504  latpO  laavl51.068  1794  eO  sz38fl.436  SZS241.905  1 1 1204 27  thl0.004  io6.5932  ch76.598  chc3.4116  qdl. 00126  ssch!2113  conn52 
.1422  disc21 . 8234  pend. 234253  cpu3219.16  uO 

exorSn  10  t8  s3  16  lat780  dll  cr5  ro?. 90377  la77B  lap. 90169  latp. 907834  laav568.722  11953  eO  SZ400.03  szs245.661  tl241233  thl2.6508  loB. 09592  ch77.9507  chc3. 53921  qd4. 63953  ssch29 
967  conn53.247  disc21.9967  pend. 232426  cpu7045.45  uO 

exor5n  10  t8  s4  16  lat-1  dll  cr5  ro2. 61631  la58  lap. 909413  latpO  laav48.2032  13102  eO  szl. 56319  szs, 915712  til50179  th. 126125  lo20.6553  ch21.8317  chc. 833387  qdl. 00032  sschll436  co 
nn3. 20148  disci?, 8845  pend. 23085  cpu3420.03  uO 

eXDrSn  10  t8  s4  16  latl48  dll  cr5  rol. 8602  la!48  lap. 901677  latp. 90561  laav88.?933  14837  eO  szl. 58611  szsl. 00450  tl60116.3  th. 498512  lo80.4606  ch21.8594  chc. 795872  qd? . 32396  sschl 
7935  conn3. 24032  disci?. 8482  pend. 230614  cpu5023.96  uO 

rO  10  tl3  si  110  lat-1  dlO  crO  rolO.9142  la67  lap. 915101  latpO  laav59.9931  11331  eO  szlOO  szsO  tl80160.6  th6.486  lol6.6042  ch40.8418  chcl. 2694  qdl. 00075  sschl3310  conn!6.1564  disc 
23.3885  pend. 259606  Cpu3303.44  uO 

rO  10  t 13  si  110  lat-2  dlO  era  ro3. 35535  lalOO  lap. 948953  latpO  laav86.G486  11391  eO  szlOO  szsO  t!60120.7  th9. 03781  lo23.1368  ch40.5287  chcl. 2056  qd2. 00288  sschl3912  connl6.1601  d 


isc23.0612  pend. 239834  cpu2899.69  uO 

rO  10  tl 3  si  110  lat-3  dlO  crO  ro3. 60804  lal49  lap. 895263  latpO  laav/130.183  12301  eO  szlOO  szsO  61100194  th8. 97085  io22.9654  ch40.4575  chcl. 17716  qd3. 00391  ssch23021  connl6.1602  d 
isc22.9784  pend. 239514  cpu4861.19  uO 

rO  10  Cl 3  si  110  lat 268  dlO  crO  ro3. 77606  la280  lap. 901217  latp. 894775  laav230.215  11397  eO  szlOO  szsO  U60271.3  th9.0541  io23.1785  ch40.2444  chcl. 63311  qd5.3801  sschl3902  connl6. 
1601  disc22 . 7762  pend. 239302  cpu2977.17  uO 

rO  10  C13  s2  110  lat-1  dlO  crO  ro. 705255  la50  lap. 903539  latpO  laav41.6041  11441  eO  szlO  szsO  ti60131.2  th. 936104  io23.9643  ch40.6861  ohcl. 35061  qdl. 00069  sschl441  connl6.15B6  dis 
c23. 2997  pend. 229441  cpu518.672  uO 

rO  10  tl3  s2  110  lat-10  dlO  crO  rol. 21883  lall6  lap. 902157  latpO  laav67.1037  18902  eO  szlO  szsO  C160098.1  th5. 78612  lol48.125  ch40.1194  chcl. 20541  qdlO.0112  ssch8911  connl6.1585  d 
isc22. 6713  pend. 230877  cpu4375.52  uO 

rO  10  tl3  s2  110  lat -20  dl 0  crO  rol. 1498  ia204  lap. 900425  latpO  laavl05.745  115069  eO  szlO  szsO  tl80312.1  th7. 32931  lol87.63  ch40.2185  chcl. 16765  qd20.0265  sschl5087  connl6.1577  d 
isc22.7513  pend. 232923  cpu7794.66  uO 

rO  10  t 13  s2  110  lat-30  dlO  crO  rol. 03933  la305  lap. 900229  latpO  laavl46.2  112257  eO  szlO  szsO  tl60302.3  th7. 93981  lo203.259  ch40.262  chcl. 18572  qd30.0734  sschl2286  connl6.1586  dl 
SC22.7896  pend. 233163  cpu6086.58  uO 

rO  10  tl3  s2  110  lat-40  dlO  crO  rol .18639  la394  lap. 899702  latpO  laavl84.899  121545  eO  szlO  szsO  tll00443  th8. 37888  io214.499  ch40.1722  chcl. 1554  qd40.0743  ssch21584  connl6.1589  d 
lsc22. 6932  pend. 233376  cpul4539.3  uO 

rO  10  t 13  s2  110  lat-5  dlO  crO  ro. 978902  ia81  lap. 896564  latpO  laav51.8916  15763  eO  szlO  szsO  C160083.6  th3. 74673  lo95.9164  ch40.2876  chcl. 24688  qd5. 00434  ssch5767  connl6.1592  dis 
C22.8562  pend. 231119  cpu2253.69  uO 

rO  10  t!3  s2  110  lat-60  dlO  crO  ro. 890886  la572  lap. 899924  latpO  laav266.355  122461  eO  szlO  szsO  U100662  th8. 71617  io223.134  ch40.143B  chcl. 16133  qd60.1603  ssch22519  conn!6.1589 
disc22. 6605  pend.233B49  cpull555.7  uO 

rO  10  tl3  s2  110  lat200  dlO  crO  rol. 17718  la204  lap. 899785  latp. 895759  laavl03.998  111197  eO  szlO  szsO  ti60212.9  th7. 26394  lol85.9S7  ch40.2394  chcl. 35219  qdl9.7151  sschll216  connl 
6.1595  disc22.7652  pend. 233107  cpu6151.8  uO 

rO  10  tl3  s4  110  lat-10  dlO  crO  ro. 990739  la64  lap. 898565  latpO  laav47.5822  120834  eO  szl. 56813  szs. 962848  tll00090  thl.2913  io208.1S3  ch27.6024  chc. 690678  qdlO.0048  ssch20B42  con 
n3. 24217  disc23.567  pend. 230476  cpul2404.1  uO 

rO  10  L13  s4  110  lat-20  dlO  crO  ro. 935774  lal46  lap. 899981  latpO  laav73.4698  116210  eO  szl. 59112  szs. 963425  C160190  thl. 67387  lo269.314  ch27.7813  chc. 666457  qd20.0247  sschl6227  co 
nn3. 24531  disc23 . 7377  pend. 230624  cpul0099.6  uO 

rO  10  t 13  s4  110  lat-30  dlO  crO  ro. 893814  la213  lap. 900333  latpO  laavlOl.761  123439  eO  szl. 58701  szs. 964498  C180155.1  thl. 81279  lo292.421  ch27.8818  chc. 650426  qd30.0384  ssch23466 
conn3. 24082  disc23. 8375  pend. 230559  cpul4802.1  uO 

rO  10  tl3  s4  110  lat-40  dlO  crO  rol. 00655  la263  lap. 899526  latpO  laavl28.214  124764  eO  szl. 59203  szs. 995696  C180208.8  thl. 92004  lo308.744  ch27.852  chc. 647687  qd40.0646  ssch24804  c 
onn3.247  dl sc23 . 7 94  pend. 231674  cpul8853.9  uO 

rO  10  t 13  s4  110  lat-5  dlO  crO  ro. 893866  la58  lap. 900659  latpO  laav35.7411  18346  eO  szl. 56578  szs. 97687  U60055.9  th. 849989  iol38.971  ch27.4735  chc. 73302  qd5.003  ssch8351  Conn3.20 
457  dlsc23. 4976  pend. 231461  cpu3576.07  uO 

rO  10  t7  S3  16  lat-2  dlO  crO  ro5. 21851  la282  lap. 89934  latpO  laavl98.218  1606  eO  sz392.757  szs239.759  tl60321.8  thl5.4128  lol0.0461  ch98.2249  chc3. 66428  qd2.0066  ssch5748  conn68.2 
546  dis c2 6. 7472  pend.23l2l5  cpul278.97  uO 

rO  10  t7  S3  16  lat-3  dlO  crO  ro3. 99026  la403  lap. 899637  latpO  laav290.88  1827  eO  sz398.622  szs240.167  tl80489.1  thl5.9989  lol0.2747  ch98.0513  chc3. 53301  qd3. 01088  ssch7863  conn69. 
02B 4  di sc25 .7663  pend. 230963  cpul721.91  uO 

rO  10  t7  s3  16  lat-4  dlO  crO  ro3. 23874  la500  lap. 900474  latpO  laav378.644  1633  eO  SZ386.904  szs229.408  tl60257.8  thl5.8764  lol0.5049  ch95.861  chc3. 88549  qd4. 02528  ssch6050  conn66. 
89  di sc25 . 91B5  pend. 231119  cpul312.16  uO 

rO  10  1 7  S3  16  lat-5  dlO  crO  ro4. 02901  la626  lap.  900322  latpO  laav482.684  11244  eO  sz394.197  szs237.371  tll20560  thl5.8888  lol0.3185  ch96.8872  chc3. 45381  qd5.0201  sschll910  conn67 
.7891  disc25.8691  pend. 231518  cpu2603.27  uO 

rO  10  t7  s3  16  lat-1  dlO  crO  ro22.962  lal95  lap. 901484  latpO  laavl21.387  1741  eO  sz377.236  szs236.316  tl90183.6  thl2.1078  lo8. 21657  ch94.0301  chc4. 04791  qdl. 00135  ssch7042  conn65. 
2886  disc25 . 6957  pend. 234388  cpul870.75  uO 

rO  10  t7  s4  16  lat-10  dlO  crO  ro. 86872  la87  lap. 90126  latpO  laav48,3705  112310  eO  szl. 58741  szs. 966517  tl6016Q  thl. 26082  lo204.621  ch27.6225  chc. 695207  qdlO.OOBl  sschl2317  conn3.2 
4203  disc23 .5997  pend. 229292  cpu7065.41  uO 

rO  10  t7  s4  16  lat-20  dlO  crO  ro. 895941  lal63  lap. 899593  latpO  laav78.081  115264  eO  szl. 58045  szs. 965373  tl60142.2  thl. 56686  lo253.798  ch27.7319  chc. 673439  qd20.0262  sschl5284  con 
n3. 23  disc23.7116  pend. 229402  cpu9353.84  uO 

rO  10  1 7  s4  16  lat-30  dlO  crO  ro. 768451  la250  lap. 900178  latpO  laavl09.S94  116336  eO  szl. 57952  szs. 966781  U60238.4  thl.  67324  lo271.189  ch27.7002  chc. 67404  qd30.0551  sschl6364  con 
n3. 22896  dise23.6815  pend. 230125  cpu8942.36  uO 

rO  10  t7  s4  16  lat-40  dlO  crO  ro. 908068  la344  lap. 900106  latpO  laavl40.287  134033  eO  szl. 58311  szs. 960434  til20661  thl. 74424  10282.056  ch27.9113  chc. 66123  qd40.047  ssch34070  conn3 
.23476  dl sc23 .8807  pend. 230269  cpu22798.3  uO 

rO  10  1 7  s4  16  lat-5  dlO  crO  ro. 98066  la59  lap. 897506  latpO  laav36.408  110908  eO  szl.  59571  szs. 986296  tl80112.2  th. 848712  lol36.159  Ch27.4932  chc. 732292  qd5. 00229  sschl0911  conn3. 
25407  disc23 .4663  pend. 230426  cpuS515.88  uO 

rl  10  tl3  si  110  lat-1  d20  crl  rol5.2739  la66  lap. 901883  latpO  laav59.2635  11009  eO  szlOO  szsO  tl60062.7  th6. 56215  lol6.7991  ch37.5749  chcl. 5554  qdl. 00099  sschl0090  conn!6.1579  dl 
sc'20.1441  pend. 231364  cpu3072.1  uO 

rl  10  t 13  si  110  lat-2  d20  crl  rol2.154  la67  lap. 907957  latpO  laav58.4596  12727  eO  szlOO  szsO  t!80101.4  thl3.2986  1034.0443  ch40.6704  chcl. 34514  qd2. 00147  ssch27280  connl6.1573  dl 
SC23.155  pend. 24304  cpu7249.84  uO 

rl  10  tl3  si  110  lat-3  d20  crl  rol. 21598  la89  lap. 904019  latpO  laav69.9565  12563  eO  szlOO  szsO  tl60120.4  thl6.6528  lo42.6311  ch38.395  chcl. 26894  qd3. 00351  ssch25640  connl6.1581  dl 
sc20.8425  pend. 2369  cpu6070.17  uO 

rl  10  tl3  si  110  lat-4  d20  crl  ro5.428  lall3  lap. 897354  latpO  laav84.4209  12835  eO  szlOO  szsO  t!60128  thl8.4177  lo47.1494  ch36.9357  chcl. 23684  qd4. 00564  ssch28369  connl6.1599  disc 
19.3927  pend. 235579  cpu648B.48  uO 

rl  10  t 13  si  110  lat-6  d20  crl  ro4.5305  Ia366  lap. 903161  latpO  laavll9.97S  13986  eO  szlOO  szsO  tl80160.2  th!9.424  io49.7254  ch36.347  chcl. 22342  qd6. 00903  ssch39907  connl6.1584  dis 
cia.7665  pend. 234889  cpu9159.99  uO 

rl  10  t 13  si  110  lat268  d20  crl  ro3. 81745  la267  lap. 899065  latp. 903902  laavl84.82  13101  eO  szlOO  szsO  tl60150.3  th20.1384  1051.5542  ch35.7852  chcl. 45479  qd9. 61754  ssch31064  Connie 
.1607  discl8.2555  pend. 231738  cpu6997.21  UO 

rl  10  t 13  s2  110  lat-1  d20  crl  rol. 04057  la46  lap. 887811  latpO  laaw38.7214  12576  eO  szlO  szsO  tll00086  thl. 00538  io25.7378  ch37.3707  chcl. 55027  qdl. 00039  ssch2576  connl6.159  disci 
9.9779  pend. 228571  cpul069.96  uO 
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rl  10  tl3  s2  no  lat-10  d20  crl  rol. 63572  la64  lap. 897562  latpQ  laav46.6097  117025  eO  szlO  szsO  t!80094.4  th8. 30319  lo212.562  ch38.0742  chcl. 39662  qdl0.0059  sschl?032  connl6.158  d 
1SC2X.3616  pend. 231403  cpul0391.4  uO 

rl  10  t 1 3  s2  110  lat-120  d20  crl  ro. 998273  la491  lap. 900194  latpQ  Uav230.737  131016  eO  szlO  szsO  tl60895.7  thl9.8957  lo509.33  ch35.5888  chcl. 26179  qdl20.464  ssch31132  conn!6.1594 
dlscl7. 9866  pend. 231993  cpul7574.1  uO 

rl  10  tl3  s2  110  lat-20  d20  crl  rol. 29106  ia97  lap. 901098  latpO  laav58.5605  18483  eO  szlO  szsO  1125109, 7  chl3.1968  lo337.837  ch37.941  chcl. 36602  qd20.0472  ssch8498  connl6.159  disc 
20.4072  pend. 231885  cpu4297.37  uO 

rl  10  tl3  s2  110  lat-4Q  d20  crl  rol. 17599  lal68  lap. 900102  latpO  laav89.5311  18873  eO  szlO  szsO  tl20136.9  thl7.2123  io440.634  ch36.9337  chcl. 34399  qd40.1B03  ssch8906  connl6.157  di 
SC19.3253  pend. 230963  cpu4958.82  uO 

rl  10  tl3  s2  110  lat-60  d20  crl  rol. 04756  la247  lap. 900317  latpO  laavl22.614  112108  eO  szlO  szsO  ti2S371.7  thl8.6416  lo477.224  ch36.2127  chcl. 31462  qd60.2973  sschl2159  connl6.1606 
disci 3. 651 6  pend.  232482  cpu6295.86  uO 

rl  10  t:  1 3  s2  110  lat-80  d20  crl  rol. 02431  la332  lap. 899883  latpO  laavl58.468  130099  eO  szlO  szsO  t!60298.6  thl9.4987  10499.166  ch35.9097  chcl. 25027  qd80.2126  ssch30169  connl6.15B3 
dlscl8 . 2853  pend. 233526  epul6479.4  uO 

rl  10  tl3  s2  110  lat200  d20  crl  rol. 48289  la202  lap. 899572  latp. 898323  iaavl08.062  15704  eO  szlO  szsO  til2545.1  thl7.761  lo454.681  ch36.2732  chc3. 25273  qd51.9111  ssch5742  connl6.1 
59  di scl8 .705  pend. 231211  cpu4802  uO 

rl  10  1 7  s3  16  lat-1  d20  crl  ro28.3821  la203  lap. 899859  latpO  laavl26.968  1709  eO  sz392.992  SZS236.015  tl9O202.1  thl2.0556  io7. 85316  ch93.631  chc4. 44212  qdl. 00141  ssch7335  conn67. 
0923  di sc23 . 4308  pend. 230924  cpu2302.04  uO 

rl  10  1 7  s3  16  lat-10  d20  crl  ro7. 41292  la762  lap. 900135  latpO  laav539.188  11483  eO  SZ397.636  szs238.223  tl80607.6  Ch28.5766  1018.3978  ch95.7659  chc3. 67781  qdl0.0674  sschl5652  con 
n68 .8772  disc23.6756  pend. 230665  cpu3672.81  uO 

rl  10  t7  s3  16  lat-2  d20  crl  ro24.3435  la216  Up. 901739  latpO  laavl3B.982  11150  eO  sz395.217  szs233.114  tl80200.7  th22.1368  lol4.339  ch96.9851  chc3. 40439  qd2. 00348  sschl2132  cohn6 
7.9881  di sc2S .7417  pend. 232018  cpu3314.31  uO 

rl  10  t7  s3  16  lat-3  d20  crl  rcl5.3388  la294  lap. 9  latpO  laavl87.484  11600  eO  SZ398.989  szs230.14  t!109487  th24.8159  lol5.9224  ch96.8884  chc3. 27476  qd3. 00562  sschl7206  conn68.4666 
disc25.0257  pend, 231971  cpu4275.09  uO 

rl  10  1 7  S3  16  lat-4  d20  crl  rol2.5302  la355  lap. 900713  latpO  laav227.831  12105  eO  SZ383.348  szs240.341  til20436  th26.1727  iol7.4781  ch94.4707  chc3. 19076  qd4.0076  ssch21866  conn66 
.6769  disc24.5411  pend. 232438  cpu5286.51  uO 

rl  10  t7  s3  16  lat-6  d20  crl  ro9. 05292  la497  lap. 900407  latpO  laav324.507  11477  eO  SZ391.414  szs240.545  ti80516.3  th28.0474  lol8.3441  ch94.6888  chc3. 45777  qd6. 02437  sschl5293  conn 
67.6014  disc23.7628  pend. 231066  cpu3600.67  uO 

rl  10  t7  s4  16  lat-10  d20  crl  rol. 2904  la55  lap. 901971  latpO  laav34.5171  111466  eO  szl. 57841  szs. 979558  tl4O075.2  thl. 76407  lo286.112  ch26.26  chc. 896487  qdl0.0087  sschl2626  conn3. 
22773  dlsc22. 2075  pend. 230078  cpu7178.12  uO 

rl  10  t?  s4  16  lat-20  d20  crl  rol. 20264  la86  lap. 899735  latpO  laav47.5956  116609  eO  szl. 57969  szs. 958429  tl40047.7  th2. 55916  lo414.731  ch26.3216  chc. 828242  qd20.0241  sschl8256  con 
n3. 22763  disc22 .255  pend. 230282  cpull742.1  uO 

rl  10  1 7  s4  16  lat-40  d20  crl  ro.  964666  lal58  lap. 899722  latpO  laav75.8338  i31361  eO  szl. 58267  szs. 97109  tl60159.3  th3. 22282  lo521,299  ch25.9167  chc. 78415  qd40.051  ssch34534  conn3 
.23292  disc21 .8344  pend. 230329  cpul9140.7  uO 

rl  10  1 7  s4  16  lat-60  d20  crl  ro. 958985  la239  lap. 900165  latpO  laavl07.102  155716  eO  szl. 59236  szs. 981172  til00286  th3. 45573  io555.569  ch25.7732  chc. 780143  qd60.0646  ssch61315  con 
n3. 24677  disc21,6683  pend. 230828  cpu34985.9  uO 

rl  10  1 7  s4  16  lat-80  d20  crl  ro.  924845  la324  lap. 899718  latpO  laavl37.769  134593  eO  szl. 57234  szs. 939613  tl60744.7  th3. 49773  io569.4Bl  eh25.  6817  chc. 803737  qdBO.185  ssch38138  con 
n3. 21715  di sc21 .6027  pend. 231409  cpu21306.3  uO 

rl  10  t7  34  16  lat-1  d20  crl  rol. 1807  la35  lap. 901693  latpO  laav26.S444  13367  eO  szl. 56638  szs. 951905  tl90045.5  th. 22879  lo37.3922  ch24.8815  chcl. 08594  qdl. 0003  ssch3705  conn3.206 
11  disc20 . 9323  pend. 230055  cpul722.05  uO 

rl  10  t8  S3  16  lat-2  d20  crl  rol2.7413  la278  lap. 899876  latpO  laavl97.837  1809  eO  sz395.726  szs230.404  U80380.2  thl5.558  lol0.0647  ch97.0105  chc2. 97011  qd2. 00494  sschl4786  conn67 
.8461  disc26. 058  pend. 230731  cpu3291.64  uO 

rl  10  t8  s3  16  lat-3  d20  crl  ro9. 41733  la382  lap. 902468  latpO  laav282.131  1851  eO  SZ393.031  szs233.04?  tl80421.3  thl6.2459  iolO.5818  ch97.119  chc3. 03891  qd3. 01058  sschl5346  conn67 
.9386  disc26. 2374  pend. 231236  cpu3359.14  uO 

rl  10  t8  s3  16  lat-5  d20  crl  ro7. 78226  la589  lap. 899851  latpO  laav448.055  1669  eO  SZ391.049  szs223.265  tl60452.3  thl6.9046  loll. 0666  Ch94.8819  chc3. 43829  qd5. 03737  sschl2035  conn6 
7.1324  disc24 . 9378  pend. 230315  cpu2616.18  uO 

rl  10  t8  s3  16  lat-1  d20  crl  ro41.1312  la223  lap. 900107  latpO  laavl39.854  11072  eO  SZ387.08  szs233.077  til50404  thlO.777  io7. 12746  ch95.2532  chc3. 34393  qdl. 00093  sschl9436  conn66. 
674  disc25.8446  pend. 230816  Cpu5496.81  uO 

rl  10  t8  s4  16  lat-10  d20  crl  rol. 96273  la85  lap. 899255  latpO  laav50.8573  111675  eO  szl. 59143  szs. 976957  tl60128,6  thl. 20705  lol94.167  ch27.7042  chc. 840656  qdl0.0086  ssch22193  con 
n3. 24216  disc23.6588  pend. 230225  cpul0772.8  uO 

rl  10  1 8  s4  16  lat-20  d20  crl  rol. 81778  lalSO  lap. 899976  latpO  laav77.7727  125451  eO  szl. 58135  szs. 969057  til00168  thl. 56952  lo254.084  ch27.8575  chc. 777786  qd20.0157  ssch48433  con 
n3. 22708  disc23.8177  pend. 230053  cpu26050.5  uO 

rl  10  t8  s4  16  lat-30  d20  crl  rol. 51382  la217  lap. 899682  latpO  laavlQ5.338  116982  eO  szl. 56695  szs. 956673  C160165.8  thl. 72765  lo282.254  ch27.7756  chc. 78234  qd30.053  ssch32302  conn 
3.20754  disc23.7539  pend. 230465  cpul4630.9  uO 

rl  10  t8  s4  16  lat-40  d20  crl  rol. 40575  la335  lap. 900043  latpO  laavl37.832  134644  eO  szl. 58674  szs. 966957  til2036?  thl. 78397  io287.821  ch27.8915  chc. 780023  qd40.0462  ssch65857  con 
n3. 23728  di sc23. 841 1  pend. 230828  cpu27303  uO 

rl  10  t8  s4  16  lat-5  d20  crl  ro2. 13219  la61  lap, 902366  latpO  laav39.5674  110017  eO  szl. 58481  szs. 969651  t!80122.4  th. 773962  iol25.021  ch27.5587  chc. 90235  qd5.0025  sschl9039  conn3. 
23515  disc23. 5418  pend. 229101  cpu8392,07  uO 

rl  10  t8  s4  16  lat-1  d20  crl  ro2. 15065  la41  lap. 898073  latpO  laav33.1545  12698  eO  szl. 59081  szs. 949865  tl90030.6  th. 186221  1029.9676  ch27.2992  chcl, 08591  qdl. 00037  sschS129  conn3. 
24797  dlsc23. 3078  pend. 229522  cpu2048.25  uO 

rl  10  t9  si  110  lat-1  d20  crl  ro23.7551  la79  lap. 90024  latpO  laau71.8749  1832  eO  szlOO  szsO  ti60115,8  th5. 40624  iol3.04  ch40.6527  chcl. 33362  qdl. 0012  sschl6640  connl6.148  dlsc23.3 
471  pend. 230969  cpu4497.08  uO 

rl  10  1 9  si  110  lat-2  d20  crl  ro6. 65526  lalOO  lap. 935391  latpO  laav85,753  11393  eO  szlOO  szsO  tl60108,l  th9. 05269  io23.1749  ch40.3174  chcl. 11262  qd2. 00287  ssch27880  connl6.1455  dl 
sc2 2 . 9439  pend.  2334  94  cpc5806.27  uO 

rl  10  1 9  si  110  lat-3  d20  crl  ro6. 36716  la!48  lap. 845661  latpO  laavl27.49  11406  eO  szlOO  szsO  ti60100.5  th9. 13834  lo23.3942  ch40.1976  chcl. 13216  qd3.0064  sseh28141  ccnnl6.1449  dls 
022.8148  pend.  234767  cpi)5812.09  qO 

rl  10  1 9  si  110  lat.ZfcB  ti20  crl  ro6. 97658  la279  lap. 900648  latp. 898488  laav212.635  11389  eO  szlOO  szsO  ti60160.2  th9.0189  1023.0884  ch40.2343  chcl. 50164  qd4. 95104  ssch27813  conn!6. 


1451  disc22.861  pend. 23311  8  Cpu5824.14  llO 

rl  10  19  s2  110  lat-1  <120  crl  ro2. 5168b  lab4  lap. 892479  latpO  laa<;46.9336  11702  eO  szlO  szsO  1180133.9  th.  829666  lo21.2394  ch40.4852  chcl .  44619  qdl. 00059  ssch3404  connl6.1492  disc 
23.2104  pend. 229716  cpul226.12  uO 

rl  10  19  s2  110  lat-10  d20  crl  ro2. 38107  lal20  lap. 900546  latpO  laav71.026?  111184  eO  szlO  szsO  1180098.2  th5. 45424  iol39.629  ch40.3331  chcl. 21833  qdl0.0089  ssch22378  connl6.1458 
dlsc22 .9735  pend. 230924  cpu9855.31  uO 

rl  10  1 9  s2  110  lat-20  d20  crl  ro2.1642  la210  lap. 900034  latpO  laavl09.592  114507  eO  szlO  szsO  H80335.1  th7. 05395  tol80.581  ch40.3846  chcl. 16934  qd20.0276  ssch29048  connl6.1462  d 
isc22 . 999  pend. 231918  cpul 4141.7  UO 

rl  10  1 9  s2  110  lat-30  d20  crl  ro2. 01732  la295  lap. 89974  latpO  laavl  46.947  116222  eO  szlO  szsO  1180330.9  th7. 88827  lo201.94  ch40.2482  chcl. 14463  qd30.05S5  ssch3249S  connl6.1467  di 
sc22.8581  pend. 231794  cpul6035.6  uO 

rl  10  1 9  s2  110  lat-40  d20  crl  rol. 63796  la389  lap. 899739  latpO  laavl88.B67  121100  eO  szlO  szsO  H100569  th8. 19558  lo209.807  ch40.3267  chcl. 12995  qd40.0758  ssch42264  connl6.1452  d 
isc22 . 9405  pend. 231517  cpul6671.1  uO 

rl  10  1 9  s2  110  lat-5  d20  crl  ro2. 61177  ia83  lap. 903196  latpO  laav55.5331  15382  eO  szlO  szsO  1160106.4  th3.4977  lo89.5412  ch40.2843  chcl. 31357  qd5. 00465  sschl0767  connl6.1456  disc 
22.9519  pend. 230452  cpu3939.94  uO 

rl  10  1 9  s2  110  lat-60  d20  crl  rol. 39577  la580  lap.  900068  latpO  laav270.79  113253  eO  szlO  szsO  U61270.4  th8. 44935  lo216.303  ch40.3588  chcl. 17132  qd60.2716  ssch26609  connl6.1472  d 
i sc22 .9657  pend. 232227  cpu9134.22  uO 

rl  10  1 9  s2  110  lat200  d20  crl  ro2. 24985  ial97  lap. 900458  latp. 906038  laavl05.451  118116  eO  szlO  szsO  H100186  th7.0634  lol80.823  ch40.2597  chcl. 23105  qdl9.2829  ssch36257  connl6.1 
459  disc22 , B907  pend. 23091  cpul8973  uO 

rl  10  t9  s4  110  lat-1  d20  crl  ro2. 29313  la42  lap. 898698  latpO  laav33.7869  11767  eO  szl.  59253  szs. 971181  U60049.2  th.  183053  io29.4259  ch27.4406  chcl. 03223  qdl. 00057  ssch3534  conn3 
.24759  disc23 .4602  pend. 228908  cpul282.2  uO 

rl  10  1 9  s4  110  lat-10  d20  crl  rol.  89674  la84  lap.  897723  latpO  laav50.535i  111773  eO  szl. 58201  szs.  985328  tl60080.8  thl. 21093  lol95.953  ch27.6324  chc. 825088  qdl0.0085  ssch23564  co 
nn3. 22888  disc23. 5975  pend. 230757  Cpu9981.45  UO 

rl  10  1 9  s4  110  lat-20  d20  crl  rol. 82327  la  1 4  6  lap.  900253  latpO  laav76.9875  115440  eO  szl. 57494  szs. 947293  tl60143.1  thl. 57937  10256.721  ch27.7337  chc. 769654  qd20.0259  ssch30911  c 
onnj. 21774  disc23.6943  pend. 230856  cpul5475.1  uO 

rl  10  1 9  s4  110  lat-30  d20  crl  rol. 32491  U202  lap. 899463  latpO  laavl04.391  14306  eO  szl. 57524  szs. 951948  tll5430.7  thl. 7171  io279.053  ch27.9022  chc. 845771  qd30.209  sschB655  conn3 
.2176  dlsc23. 8692  pend. 231243  cpu3109.07  uO 

rl  10  1 9  s4  110  lat-40  d20  crl  rol. 32312  la286  lap. 900056  latpO  laav!33.722  117858  eO  szl. 58159  szs. 953024  tl60418.5  thl. 82607  lo295.572  ch27.9288  chc. 748602  qd40.0896  ssch35769  c 
onn3. 22827  disc23 .8876  pend. 231555  cpul3395.5  uO 

rl  10  1 9  s4  110  lat-5  d20  crl  ro2. 21947  la61  lap. 902265  latpO  laav39.4625  17551  eO  szl.  58496  szs. 983323  tl60100.9  th. 777859  iol25.639  ch27.5223  chc.  904422  qd5. 00331  sschl5106  conn 
3.23487  dlsc23 . 4948  pend. 230368  cpu5872.32  uO 

r5  10  t 13  si  110  lat-1  dll  cr5  roll. 3352  la67  lap. 905592  latpO  laav59.9421  11663  eO  szlOO  szsO  tilOOlSO  th6. 48636  lol6.6051  ch40.5656  chcl. 27696  qdl. 0006  sschl6630  connl6.1577  dls 
C23.1211  pend. 243831  cpu4351 . 58  uO 

r5  10  tl3  si  110  lat-2  dll  cr5  ro4. 50801  la99  lap. 826176  latpO  laav81.5456  11467  eO  szlOO  szsO  tl60116.5  th9. 53227  io24.4026  ch40.2647  chcl. 21179  qd2 . 00273  sschl4678  connl6.1616  d 
1 sc22 . 82  pend. 234687  cpu3320.55  uO 

r5  10  tl3  si  110  lat-4  dll  cr5  ro4. 15937  lalSB  lap. 899866  latpO  laavl60.013  11498  eO  szlOO  szsO  tl60190.3  th9. 72177  lo24.8877  ch40.0174  chcl. 25828  qd4. 01068  sschl4987  connl6.1572 
disc22.5523  pend. 235032  cpu3334.59  uO 

r5  10  t 13  si  110  3at268  dll  cr5  ro2. 94511  la269  lap. 900048  latp. 900048  laav224.715  12071  eO  szlOO  szsO  ti80273.1  thl0.0779  lo25.7994  ch39.7233  chcl. 43783  qd5. 85128  ssch20747  connl 
6.1602  dlsc22.2857  pend. 233987  epu4499.94  uO 

rS  10  tl3  s2  110  lat-1  dll  cr5  ro. 761049  la50  lap. 890287  latpO  laav41.8S32  11431  eO  szlO  szsO  ti60079.9  th. 930402  lo23.8183  ch40.9169  chcl. 37684  qdl. 0007  sschl431  connl6.1538  disc 
23.5301  pend. 235606  cpu542.523  uO 

r5  10  tl3  s2  110  lat-11  dll  cr5  rol. 03698  lall7  lap. 898769  latpO  laav67.92  112928  eO  szlO  szsO  tl80120.9  th6. 30297  10161.356  ch40.2002  chcl. 21006  qdll.0094  sschl2940  connl6.1581  d 
lsc22 . 7322  pend. 230212  cpu4S63.46  uO 

r5  10  tl3  s2  110  lac-22  dll  cr5  ro. 919469  la20Q  lap. 899603  latpO  laavl04.356  112614  eO  szlO  szsO  tl60174  th8.1885  lo209.625  ch40.2157  chcl. 18454  qd22.0384  sschl2634  connl6.1605  dl 
sc22 . 7555  pend. 231229  cpu4364.6  uO 

r5  10  t 13  s2  110  lat-33  dll  cr5  ro. 822303  la294  lap. 90023  latpO  laavl44.318  127388  eO  szlO  szsO  til20344  th8. 80986  io227.58  ch40.1801  chcl. 14896  qd33.0398  ssch27420  connl6.1602  dl 
sc22 . 7203  pend. 231068  cpu9346.5b  uO 

r5  10  tl3  s 2  110  lat-44  dll  cr5  ro. 767645  la389  lap. 900325  latpO  laavl85.579  114189  eO  szlO  szsO  tl60272.7  th9. 19584  io235.414  ch40,2438  chcl. 18828  qd44.1364  sschl4232  connl6.1603 
disc22 .7787  pend. 233102  cpu4822.15  uO 

r5  10  t 13  s2  110  lat-5  dll  cr5  ro. 841438  laBG  lap. 897993  latpO  laav51.0889  19764  eO  szlO  szsO  ttl00072  th3. 81133  lo97.57  ch40.3146  chcl. 24967  qd5. 00256  ssch9765  connl6.1584  disc22 
.8712  pend. 232445  cpu3S17.8  uO 

r5  10  tl3  s2  110  lat-66  dll  cr5  ro. 640518  la567  lap. 900071  latpO  laav265.378  119765  eO  szlO  szsO  tl80801.5  th9. 55515  io244.612  ch40.232  chcl. 17719  qd66.2204  sschl9832  connl6.1548 
dlsc22. 7583  pend. 232565  cpu6569.03  uO 

r5  10  tl3  s2  110  lat200  dll  cr5  ro. 93057  lal97  lap. 900494  latp. 90679  laav99.4472  116223  eO  szlO  szsO  tl80316.6  th7. 89016  io201.988  ch40.2069  chcl. 31036  qd20.2483  sschl6243  connl6. 
1591  disc22 .7534  pend. 231823  cpu5650.72  uO 

r5  10  t7  s3  16  lat-2  dll  cr5  ro7.7907  la283  lap. 899408  latpO  laavl96.935  11014  e3235.93  sz390.566  szs229.73  U100418  thl5.4057  iolO.0978  ch91.6424  chc3. 21165  qd2. 00394  sschll083  c 
onn63.1781  dlsc25.4343  pend. 230707  cpu5470.34  uO 

r5  10  1 7  s3  16  lat-4  dll  cr5  ro4 . 21931  la525  lap.  897764  latpO  laav383.179  1626  e2369.68  SZ398.297  szs253.055  C160459.2  thl6.1094  lol0.3541  ch93.4352  chc3.8287  qd4. 02556  ssch6814  c 
onn64 . 9666  dlsc25.3834  pend. 230791  cpu3608.66  uO 

r5  10  t7  s3  16  lat-6  dll  cr5  ro4. 22572  la725  lap. 900592  latpO  laav567.386  1845  e2774.39  sz390.217  szs237.551  t!80592  thl5.982  iolO.4849  ch90.7573  chc3. 67889  qd6.0426  ssch9293  conn 
63.2664  disc24 . 742  pend. 232089  cpu4501.05  uO 

r5  10  1 7  S3  16  lat-1  dll  er5  ro26.5285  la208  lap. 900439  latpO  laavl31.445  1683  e2249.52  sz398.141  szs233.776  tl90151.8  thll.7826  lo7. 57611  ch91.3708  ehc4. 11648  qdl. 00146  ssch7594 
conn63. 2539  disc25.1296  pend. 233026  cpu4109.66  uO 

r5  10  1 7  s4  16  lat-11  dll  cr5  ro. 817174  lal06  lap. 900854  latpO  laav56.301S  115576  e297.186  szl. 58109  szs. 957803  tl80129.5  thl. 20055  iol94. 385  ch2S. 8626  chc. 698252  qdll.0078  ssch20 
248  eonn3. 23577  disc21.8449  pend. 230998  cpu77S6.29  uO 

r5  10  t7  s4  16  lat-22  dll  cr5  ro. 743794  lal99  lap. 900806  latpO  laav93.1213  123582  e459.579  szl. 59092  szs. 983939  U100316  thl. 4609  10235.078  ch2S.937  chc. 672224  qd22.0205  ssch30704 
conn3. 24732  di sc21 .9042  pend. 230374  cpull605.2  uO 
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>.971609  t i 6051 9 . 8  thl. 56031  to250.943  ch25.976  chc. 692001  qd33.0717  ssch!98 


r5  10  t7  s4  16  lac-33  dll  cr5  ro. 681618  la289  lap. 900211  latpO  laavl29.944  115187  e298.306  szl. 59176  szs. 

%  rct^flfuu-;rdnTr^o!ML75Ul'n?69Lp°899948  latpO  laav!64.73  123299  .321.526  szl. 58176  szs.  965832  1180793.5  thl. 62884  io263.619  ch25.8493  chc.686362  qd44.0909  ssch277 
z5  10nt7l^6  ^-f^ll'LrroisiSn  la67^1ap: 900159  latpO  laa.39.6424  17532  .127.651  szl.58192  szs.980185  0160068.7  th.774829  1.125.39  ch25.7289  chc.747658  qd5.00332  »ch9641  c 
rrii2trLdir^t-rdnecr5:iro!924m3la?43Lp?9002e6  latpO  laaV30.4907  14094  e93.574  szl. 59338  szs.961543  t!150075  th.202972  lo32.6104  ch25.5465  chc.832928  Qdl.0002  ssch6427  con 
T^tTs  Tuill-l  dUd;228t9lo?29574i;3498ULp.9C09Ol  latpO  laa.252,23  11110  .35558.2  sz407.169  szs246.236  01140664  thl2.5509  io7.89116  <*78.1838  chc2.73906  qd2.0036  SSchl7266  c 
rri^te9l3diru;-939dlfcri23roa!7223?Ula475  Up.9  latpO  laav358.376  1670  e20614.4  SZ308.8O9  szs239.849  t!80510.6  thl2.6392  lc8. 32189  ch76.4364  chc3.08371  qd3.01343  Sschl0255  connS 
ri1?03t2,';32li“L#-r3?i2”5B™?S«M9il7«  lap. 896047  latpO  laa.586.453  1683  .20225.7  sz376.6  szs234.925  tl80671.3  thl2.455  ioS. 46645  ch75.7652  chcl.2365  qd5.0366  ssch10377  conn 
r^irt8dsrr6lat-lPdn-cr58ro23P77!2Bi;220°iap.898914  latpO  laav!50.17  11197  e35558.3  SZ392.126  Szs240.523  01180488  thlO.1586  lo6.63203  <*76.6334  chc3.07127  qdl.000B4  Sschl8404 
T?02t86s4  ?6Sui:i09Iircd52rol!7329fl!l856lap.900078  latpO  laavllO.  674  19012  .1532.18  szl.  58799  szs. 978986  01100166  th.558097  io09.  97O6  ch22.0802  chc.699433  qdlO.OHl  «ch3328 
r5Clonn?82!2716dUt-200dn  crf^lugoria^'iap^^Se  latpO  laavl88.123  112744  e2204.97  szl.  5747  szs. 938425  01120295  th.651653  lol05.94  ch22.1589  chc.  685329  <jd20.0314  ssch47231  0 
ri02i87s4dlrl«-40P:u-cr54!o^349574i:745  lap.900062  latpO  laav349.655  111376  .2033.26  szl.  58448  szs.954154  U100633  th.699674  10113.045  ch22.1529  chc.723549  qd40.1406  ssch421 
“  10^0 ' s4^ la' lat^-S* dll^erS11^ 22 0170 9° la  116°iap. 899951  latpO  laav73.4483  14069  .660.617  szl. 56992  szs. 943912  0160059.4  th.  415474  io67.7496  ch22.0242  chc.740487  qd5.00614  ssch!498 
r5ClSnt82s4416dlatC-l‘dn2cr5n^67957  taS^ap^mS  latpO  laav48.4377  13086  e503.625  szl.  59559  szs.94181  01150143  th.120107  lo20.5537  <*21.8946  chc.841877  qdl.00032  sschU450  co 
r^O^sf  llO^l  dnd;251rol2?P43lal74tap!910295  latpO  laav60.0034  11661  .9703.57  szlOO  szsO  01100180  th6.47662  lol6.5802  ch40.2824  chd. 27141  Qdl.0006  ssohl8271  connl6.1581 
S’SV.3!!  mdi“724dUPcr514ro3?5a46  1.100  lap.  946159  latpO  laav85.8222  11393  e9912.85  szlOO  szsO  0160108.1  0h9.0527  1.23.1749  ch40.587  chcl.2164  qd2. 00287  ssch!5334  cc.pnl6.1585 
r51lS2?90!rnon?;t-369dllCcr51rc4:U784  1.149  lap. 952722  latpO  laavl28.673  11396  .9791.93  szlOO  szsO  U60185.1  th9. 06059  L23.1951  ch40.1174  chd. 25091  qd3. 00645  ssch!5371  conn!6. 
rriOdtr2rn04lat2d82dn8cr5Pro4!o6988la266  lap.  903483  latp.904935  laav230.28  11378  .9768.3  szlOO  szsO  O160223.1  th8. 93812  1.22.8816  ch40.3068  ohol.77467  qd5. 31277  sschl5173  co 
^9S.SSl’u»  lap.  897959  latpO  laavBl.3787  1735  .993.36  szlO  szsO  0160105  th.477679  lc.12.2286  ch36.6223  chd.  4  4301  qdl.00136  ssch2940  connlC. 1567  dl 
r51102L91s2eni2l9t-10Cdn8c951ro2!37653  1.314  lap.899651  latpO  laavl90.012  13153  .4581.52  szlO  szsO  0160243.5  th2. 04444  io52.3376  ch36.4097  chd. 30682  qdlO.0317  ssch!2637  ccnnl6. 
“’iS^fd^S  ?atdi.222dU  cP57roi:i5346  1.2000  lapl  latpO  laavl812.09  15695  .10349.6  szlO  szsO  0184307.5  052.63869  io67.5503  ch36.3819  chd. 61604  qd!35.06  ssch23115  connl6.1597 
d5^08;9°s2  md;ft-206dnUcr598^. 99956  la609  lap.  900224  latpO  laav327.594  18525  .12949.3  szlO  szsO  01140696  th2. 36687  1.60.5918  ch36.4816  chcl.22886  qd20.0469  ssch34151  connl6.1 
894ldit91920U0  ?atd403ln5cr5U2“lB6i5060lall88  lap.90O151  latpO  laav596.  622  15333  e8738.11  szlO  szsO  0181172.1  th2.5664  1.65.7  ch36.3179  chd.34092  qd40.3  ssch21432  connl6.1585  d 
ir“'t492.r??i2?d”  la204  lap.901319  latpO  iaavl27.437  12351  .3341.33  szlO  szsO  0160135  thl. 52716  1.39.0954  ch36.4993  chcl.32088  qd5.01063  ssch9409  cnnl6.1581 

rdl10lt9Qs22lloniat2004dllPcr52?Q3733065  la200  lap. 900120  latp. 901413  laavl26.80B  13114  e4401.69  szlO  szsO  tl80141.2  thl. 51783  1.38.8564  ch36.36  chcl. 48639  qd4. 97431  sschl2466  con 
s4Sno'lat2iedn,22r59ro2?P72465i8580lap.89181  latpO  laav50.4289  11978  .350.202  szl.55056  szs.901477  01100113  th.119669  1.19.7576  ch21.6847  chc.804393  qdl.00051  ssch7912  c 

lap.  901278  latpO  laavll5.828  16094  e!328.16  szl.  58515  szs.944463  0180189.6  th.532332  1.85.9713  <*21.9578  chc.707047  qdlO.0145  ssch27 
85310°t93;43n0  u:-122'dn1cr5nd;i350226C?a3425iap.899B04  latpO  laav!96.464  16111  .1155.28  szl.56292  szs.913503  0160558.8  th.616072  1.100.91  ch21.894S  chc.712376  qd20.0655  ssch244 
r5  cr5d;22a89n3?225Lp!B99562  latpO  laav78.0316  16394  .1169.58  szl. 56631  szs. 965011  01100189  th.390474  1.63.8196  ch21.B3U  chc.727338  qd5. 00391  ssch2558 

r0C10n3 i'sI 4 1 S^latiao4 d lO^rolrps83.! 3^4774 8i2778° lap. 9  latp.906299  laav436.65  11270  .0  sz395.458  SZS240.885  01240861  thB.14514  1.5,27276  ch!46.228  chcl. 95588  qd2. 49843  sschl2101 

conn68.34/l  dlsc72.2224  pend2«70542  cpu2930.02  uO  .  _  „  ,  _  cei  nv,ifl  i  oac.  r’Vir-  nrii  1677  cqrh 

rO  10  t 7  s4  16  lat 1 49  dlO  cr0_rps  ro. 856389  lal51  lap. 899252  latp. 89636  laav72.9165  114190  eO  szl. 59027  szs. 97415  ti64927.7  thl. 35764  lo218.551  ch30.1806  chc. 736013  qdl6.1677  ssch 

rl2?0  t  ^sS "  169lat780Cd201crl^rpsdr212?6821Pla788  " lap^900069  latp.096377  laav470.  234  14333  .0  ..391.318  SZS237.89  01442493  01,14.9683  1.9.79224  ch149.276  chcl. 41641  qd4. 91369  ssch4 

928  lQ0^^8^ "  l^latl  487d202crlPrps4/ol  902976Ulal  48*  lap8899919  latp.  901434  laaV73.933  19951  eO  szl. 58688  szs.  957054  0121970  th2.0O762  1.452.935  ch28.94  chcl.04568  qd34.2326  sschl098 

riC?Cnta2s3°i6dta/7808d2Q  or  l^p^rol  5?36  44  l!?BO  lap.  900433  latp. 90.433  laav523.24  1693  eO  SZ405.374  szs230.439  t!120664  th9. 09437  1.5.74324  Chl61 .472  chc4 . 30QB6  qd3. 07504  sschl2 


msum 

661  conn70 .0216  dl scft4 . 943 1  pend4.C1129  cpu2988.66  uO 

rl  10  C8  s4  16  latHB  d20  crl_rps  rol. 76362  lal51  lap. 899317  latp. 895413  laav77.877  113332  eO  szl. 59421  szs. 984453  ti62487.7  thl. 32864  lo213.354  ch30.2383  chc  889074  ndl7  0644  esc 
h253 92  conn3. 24638  dlsc26.1807  pend. 245807  cpul2355.5  uO 

r5  10  1 7  S3  16  lat780  dll  cr5_rps  rolO.1128  la793  lap. 899713  latp. 891117  laav506.729  1698  el858.29  SZ405.537  szs231.83S  tll20920  th9. 14421  ioS. 77239  chl46  399  chc4  2817  qd2. 98567 
ssch7682  conn65 . 2225  disc76.025  pend2. 46802  cpu3533.89  uO 

r5  1.0  t7  s4  16  lat  148  dll  cr5_rps  ro. 781576  lal46  lap. 899284  latp.905394  laav72.0B81  111484  e222.717  szl. 58177  szs.  959935  t.161066.6  thl. 16196  iol88  057  ch27  9394  chc  811588  qdl3.8 
148  sschl5049  conn3. 23462  disc23.9189  pend. 245878  cpu5738.15  uO 

r5  10  t8  s3  16  lat 780  dll  cr5_rps  rol6.0217  la797  lap. 900431  latp. 892672  laav472.858  12320  eb8554.7  SZ395.457  szs244.553  ti523840  th6. 84146  lo4  42883  chll5  449  chc2  82027  qd2.2435 
3  ssch35582  conn52.7427  dlsc58.0988  pend2. 24576  cpu6B312.5  uO 

r5  10  t8  s4  16  latl48  dll  cr5_rps  ro2. 02673  lal48  lap. 898715  latp. 903599  laav69.5432  17780  el294.82  szl. 58342  szs. 971368  til20242  th. 400203  io64  7031  ch24  12  chc  758659  qd5  67738 
ssch28851  conn3.2358  dlsc20.0963  pend. 251027  cpu9499.74  uO 

rO  10  t7  sll  17  lat-1  d5  cr0_5  roll. 2365  lal80  lap. 899746  latpO  laavll4.093  1788  eO  szl99.187  szsll9.672  tl90108.2  th6. 80427  lo8. 74504  gh97.8557  chc4. 03813  adl  00127  ssch3768  conn 
68.531  disc26.2164  pend. 233376  cpul021.05  uO  ’ 

rO  10  1 7  sll  17  lat?20  d5  cr0_5  rol. 65872  la713  lap. 899921  latp. 903098  laav503.688  11259  eO  szl97.061  szsll8.693  t!120708  th8. 02882  iol0.4301  ch96  1804  chc4  64012  qd5  29627  ssch60 
79  conn 67 .2675  disc2S.7933  pend. 230354  cpul467.05  uO 

rO  10  1 7  s41  19  lat-1  d20  crO_ 20  ro49.3459  la231  lap. 899633  latpO  laavl46.782  1817  eO  sz776.154  szs47S.  242  U120300  th20.5903  loC. 79134  ch96  1434  chc4  17927  qdl  00122  sschl5523  co 
nn67 .193  disc25 . 7781  pend. 233497  cpu4367.56  uO 

rO  10  1 7  s41  19  lat924  d20  cr0_20  ro6. 16034  la924  lap. 9  latp.  900761  laav693.815  11280  eO  sz764.621  SZS473.908  tll20929  th31.6144  lol0.5847  ch95.598  chc5.058  qd7  44062  ssch24302  co 
nn66.542  dlsc25.8244  pend. 23154  cpu5192.47  uO 

r 0  10  c7  s4  110  latl48  d20  cr0_20  rol. 27936  lal53  lap. 900117  latp. 892282  laav82.0494  113707  eO  szl. 57584  szs. 94497  tl26900.3  th3. 13658  lo509.547  ch27  7637  chcl  04333  ad42  9815  ssc 
hl3735  conn3. 22159  dlsc23.6927  pend. 230996  cpulll84.6  uO  ’ 

r°  10  1 7  s4  110  latl48  d5  cr0_5  ro. 799109  lal50  lap. 900089  latp. 896827  laav76.5153  126986  eO  szl.  57708  szs.  94733  U197483  th. 841825  lol36.65  ch27.8176  chc. 614125  qdlO  7778  ssch269 
9?  conn3. 22366  dlsc23.8273  pend. 230212  cpul5917.8  uO 

rO  10  t7  s4  15  lat-1  dl5  cr0_15  ro. 827303  la37  lap. 891619  latpO  laav20.1861  13174  eO  szl. 57876  szs. 981205  tl90032.8  th, 217412  lo35.2538  ch27.134  chc. 970004  qdl  00032  ssch3174  conn 
3.22674  dlsc23. 1 624  pend. 231723  cpul384.63  uO 

rO  10  t7  s4  15  latl48  dl5  cr0_15  rol. 06837  lal52  lap. 900897  latp. 895863  laav74.6596  112738  eO  szl. 58431  szs. 985128  tl34353.5  th2. 29473  lo370  792  ch27  7693  chc  915595  qd28  2422  ssc 
hl2763  corm3. 23579  disc23.7172  pend. 230316  cpu9165.ll  uO  ' 

r°  10  1 7  s4  17  lat-1  dS  crO_5  ro. 530468  la37  lap.  907561  latpO  laav27.9156  14274  eO  szl. 62167  szsl.0251  11120063  th.2255  lo35.598  ch27.2557  chc. 701713  qdl  00023  Ssch4275  conn3.2906 
disc23 . 221 4  pend. 231538  cpul680.17  uO 

ro  10  1?  s4  17  latl 48  d5  cr0_5  co. 754723  lal43  lap. 899674  latp. 909394  laav70.1113  115027  eO  szl. 594  szsl. 00739  till8544  th. 789298  io!26.763  ch27  4869  chc  651365  od9  00413  sschl503 
9  conn3. 25145  disc23.4755  pend. 230432  cpu8320.77  uO 

rO  10  t7  s4  19  lat-1  d20  er0_20  rol. 02513  la37  lap. 890799  latpO  laav28.4825  13141  eO  szl. 59726  szsl. 01148  tl90039.4  th. 217657  io34.8847  ch27  2248  chcl  09595  qdl  00032  ssch3142  con 
n3.25133  disc23 . 2217  pend. 23282  cpul447.99  uO 

rO  10  1 7  s4  19  latl48  J20  cr0_20  rol. 12144  lal46  lap. 899714  latp.  904225  laav72.  5909  16709  eO  szl.  59144  szs. 961717  tll4O70.9  th2. 96237  lo476.527  ch27  8381  chcl  2698  qd3S  7478  ssch6 
733  conn3. 24825  disc23,7443  pend. 230506  cpu4722.06  uO 

rO  10  1 7  s8  15  lat-1  dl5  crO_15  ro37.3101  la219  lap. 90137  latpO  laavl37.013  11095  eO  sz595.121  szs365.859  tll50453  thl6.9192  to?. 27804  ch97.7473  chc3  86617  adl  00091  sschl5596  con 
n68 . 7603  dlsc25.7511  pend. 234316  epu4232.05  uO 

tO  10  t?  s8  15  lat876  dl5  crO_15  ro5. 88047  la862  lap. 902165  latp. 907779  laav566.304  11247  eO  SZ580.484  szs353.55  tll20260  th23.5124  iolO.3692  ch96  1939  chc5  01201  ad5  90778  sschl7 
895  conn66. 7347  disc26.1571  pend. 231838  cpu3909.27  uO  ' 

rl  10  1 7  sll  17  lat?20  dlo  crl_5  ro3. 50463  la719  lap. 899688  latp. 901471  laav451.993  12244  eO  szl97.782  szsl22.665  tll20529  thl4.384  I0I8.6I8  CH94.2395  chc4  31234  qd8  47148  sscM.19 
28  conn67 . 776  disc23.3355  pend. 230975  cpu3111.04  uO 

rl  10  t?  s4  110  latl48  d20  crl  rol. 15581  lal45  lap. 900511  latp. 906803  laav76.0887  17658  eO  szl.58214  szs. 964426  til4033.9  th3. 37241  ioS45  679  ch25  7455  chcl  43898  cd43  0837  ssch84 
51  conn3. 23232  disc21.6663  pend. 229933  cpu5709.65  uO  ' 

rl  10  1 7  s4  110  latl48  dlO  crl_5  ro. 766301  lal51  lap. 900832  latp.  8948  laav75.449  18296  eO  szl. 58233  szs. 980756  tl2B319.7  thl.B1066  io292.941  ch25.5761  chc. 812798  ad22.3697  ssch913 
5  conn3. 22468  disc21.546?  pend.  23019  cpu4407.63  uO 

rl  10  1 7  s4  17  latl48  dlO  crl_5  ro. 885874  lal42  lap. 900004  latp. 909398  laav66.8186  124280  eO  szl. 58386  szs.  96216  tl98903  thl. 51885  lo245  493  ch26  1913  chc  705472  qdl6  6646  ssch268 
03  conn3. 23521  disc22.1691  pend. 231038  cpul4826.6  uO 

rl  10  t8  sll  17  lat720  dlO  crl_5  ro3. 48483  la720  lap. 899898  latp. 900409  laav447.272  11958  eO  szl96.629  szsl20.303  tll80549  th8. 32961  lolO  8447  ch96  3563  chc3  44811  ad4  8907  sschl7 
824  conn68. 061  dlsc25.6645  pend. 231275  cpu3969.25  uO  ' 

rl  10  t8  s4  110  latl48  d20  crl  rol. 65207  lal52  lap. 899926  latp. 89404  laav78.4763  18190  eO  szl. 58974  szs. 966947  ti30939.5  thl, 64383  lo264  71  ch27  8979  chc  98308  od21  2341  sschl5622 
conn3. 24293  dlsc23.3417  pend. 23119  cpu?170.81  uO  M 

rl  10  t8  s4  110  latl48  dlO  crl_5  rol. 11532  lal48  lap. 898898  latp. 904476  laav78.?912  17176  eO  szl. 57581  szs. 998379  ti49441.8  th  893411  iol45  14  ch27  6812  chc  7271  adll  5932  sschl36 
17  conn3. 21991  disc23.6934  pend. 23093  cpu5199.95  uO  ' 

rl  10  1 8  s4  17  latl48  dlO  crl__5  rol. 23726  lal50  lap. 899662  latp. 897412  laav76.4706  110668  eO  szl. 57415  szs. 945771  t!80890  th. 810949  iol31  883  ch27  6153  chc  719427  adlO  2518  ssch20 
298  conn3. 21872  dlsc23.6345  pend. 231804  cpu8605.ll  uO 

Sl1  ^  lat 720  d6  cr5_5  ro2. 35217  la713  lap. 902786  latp. 905882  laav482.412  11615  e2561.96  szl96.672  szsll4,946  tll50370  th8. 25113  lolO  7402  ch89  6619  chc4  04697  qd5. 20557 
ssch9595  conn61 .3644  disc25.3161  pend. 231721  cpu4485.08  uO 

r5  10  1 7  s41  19  lat924  d21  cr5_20  roS. 98857  la926  lap. 900524  latp. 896335  laav695.692  1956  e6902.48  SZ822.302  szs489.902  tll00844  th30  4508  lo9  47999  ch99  2061  chc5  38765  qd6.6B933 
ssch201 1 1  conn67 .0755  disc25.9632  pend. 231617  cpul0160.8  uO 

r5  10  t7  s4  110  latl48  d21  cr5_20  ro. 912542  lal52  lap. 898977  latp. 893101  laav76.8099  117748  e377.11  szl. 58153  szs. 968487  1141264.1  th2. 65714  lo430.108  ch26  15  chc  956191  qd33.6173 
ssch23050  conn3. 24099  dtsc22.0554  pend. 23105  cpu8468.26  uO 

rS  S4  110  lat148  0,6  cr5._5  ro. 571704  lal50  lap. 901378  latp. 898098  laav77.8041  19157  el74.73  szl. 57761  szs. 982083  tl67451.8  th. 836709  10135.756  ch26  0394  chc  671097  qdlO.6295 

sschl 1895  conn3. 23262  disc22.0493  pend. 230292  cpu3821.24  uO 

,rS  ^  15  latl4B  d16  "5-15  to. 879569  la  1 47  lap. 900783  latp. 905402  laav73.4226  117133  e339.44  szl. 57737  szs.  945386  tl55661.7  thl. 89657  io307.806  Ch26.0123  chc  880246  qd22.974 

4  SSCh22338  COIin3. 22951  dlsc21.9721  pend. 230507  Cpu8834.72  uO 
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r5  10  t7  s4  1?  latl48  d6  cr5_5  ro. 647409  lal46  lap. 90093  latp. 909062  laav72.056  112794  e227.564  szl. 58176  szs. 958535  til03708  th. 762246  lol23.366  ch25.9617  chc. 659978  qd9. 06784  ss 
chl6505  cnnn3. 21968  disc21 .9796  pend. 232122  cpu6043.37  uO 

r5  10  1 7  s4  19  latl48  d21  cr5_20  ro. 967246  lal46  lap. 899966  latp.  904724  laav73.0387  18040  el94.750  szl, 58201  szs.  986248  tl21924.3  th2.4917  lo403.205  ch25.9588  chcl. 24402  qd29,9109 
sschl 1623  conn3. 23742  disc21.879  pernl. 230473  cpu4748.18  uO 

r5  10  t7  s4  19  latl48  d20  cr5  19  ro. 93677  lal47  lap. 899822  latp. 902676  laav74.0598  127069  e557.129  szl. 5855  szs.9S6773  tl69859.7  th2. 39979  io387.477  ch26.0315  chc. 928929  qd29.2609 
ssch35059  conn3. 24911  dlsc2l7941  pend. 230403  cpul4316.7  uO 

r5  10  t7  s8  15  lat876  dl6  cr5_15  ro6. 07754  la881  lap. 899745  latp. 89719  laav671.535  11567  e8457.98  sz585.886  szs348.465  tll50820  th23.77B5  lol0.3899  ch91.9465  chc4. 50626  qd7. 06892 
ssch25128  conn63.4644  dlsc25.3114  pend. 231075  cpul2639.7  uO 

r5  10  t8  all  17  lat72Q  d6  cr5_5  ro6. 86114  la728  lap. 900505  latp. 095717  laav302.7O2  13759  652413. 9  szl98.059  SZS119.535  U481245  th6. 04313  107.811  ch77.4232  chc2. 87545  qd3. 10694  ss 
ch31681  conn52 . 7428  dlsc22.0913  pond. 235653  cpu53967.3  uO 

r5  10  t.8  s41  19  1  at924  d21  cr5_20  ro26.8281  la915  lap. 899635  latp. 902372  laav610.569  11096  e73051.4  sz787.814  szs473.178  U140708  th23.9704  io7. 78918  ch78.7  chc4. 15716  qd4. 76551  s 
sch33  98  9  conn52.4603  dlsc21.5042  pend. 23244  cpu67967.3  uO 

r5  10  t8  s4  110  1  at  148  d21  cr5_20  ro2. 94622  lal51  lap. 90023  latp. 894262  laav91.8636  16543  el224  .06  szl. 60813  szs. 969601  ti4S739.9  th. 898593  10143.048  ch22.0368  chcl. 08359  qdl3.275 
4  ssch24192  corm3. 27013  discl7.917  pend. 230333  cpuB331.05  uO 

r5  10  ta  s4  1  ID  lat 148  d6  cr5_5  rol. 31611  lal49  lap. 901771  latp. 901771  laav92.7061  18979  61437.4  szl.  58136  szs. 951392  til80233  th. 30774  lo49.8189  ch22.03B7  chc. 643815  qd4.6895  ssc 
h331 64  conn3. 22705  di scl8 . 0527  pend. 232287  cpu9015.24  uO 

r5  10  1 8  s4  15  latl48  dl6  cr5_15  ro2. 49271  lal49  lap. 898913  latp.  898913  laav87.5639  157666  e9946.68  szl. 56823  szs. 964906  tl570260  th. 627366  iol01.122  ch22.0217  chc. 797074  qd9.4729 
3  ssch213208  conn3. 23902  dlscl7.9759  pend. 231492  cpu72937.4  uO 

rb  10  t8  s4  17  lat.148  d6  cr5_5  rol. 44141  lal46  lap. 898521  latp. 912336  laavBG.7338  18179  el339.62  szl. 58173  szs. 950808  t!180126  th. 280555  io45.4072  ch22.0311  chc. 653343  qd4. 11407  s 
sch30350  conn3. 23257  discl8.0432  pend. 232104  cpu9431.19  uO 

r5  10  1 8  s4  19  latl46  d21  cr5_20  ro3. 01312  lal48  lap. 899211  latp. 902753  laav88.8523  16216  ell29.82  szl.  57883  szs.  949783  tl45708.9  th. 838698  lol35.991  ch22.0465  chcl. 07097  qdl2.231 
7  ssch23040  conn3. 22259  dlscl7.9822  pend. 230767  cpu8238.61  uO 

t5  10  t8  s8  15  lat876  dl6  cr5_15  rol3.7673  la881  lap. 900058  latp. 895991  laav603.941  11721  e82953.9  sz5B1.9  SZS359.271  tl210881  thia.5504  lo8. 16102  CH76.5043  chc3. 76828  qd4. 95352  s 
Sch38l70  conn51.9973  dlsc21.7752  pend. 232800  cpu76307.B  uO 

rO  10  tl3  s3  110  lat-1  dlO  crO  ro24.1547  lal97  lap. 901981  latpO  laav]25.156  1959  eO  sz394.277  szs228.843  tll20280  thl2.2797  lo7. 97309  ch96.8582  chc3. 04001  qdl. 00104  ssch91B8  conn 
67.6977  disc26.0026  pend. 233278  cpu2382.57  uO 

rO  10  t.13  s3  110  lat 78 8  dlO  crO  ro3. 64949  la791  lap. 899764  latp. 899764  laavb73.842  1848  eO  sz386.82  szs233.658  t!80755.4  thl5.8669  lol0.5008  ch95.4764  chc5.  65818  qd6. 11439  ssch81 
06  conn66. 6576  dlsc25.5711  pend. 232361  cpul720.19  uO 

rO  10  t 1 3  s4  110  lat-1  dlO  crO  ro. 657311  la37  lap. 911594  latpO  laav27.9634  15339  eO  szl. 57558  szs. 981974  11150079  th. 218947  lo35.5745  ch27.1271  chc.B10185  qdl. 00019  ssch5340  conn 
3.22383  disc23 .1584  pend. 230352  cpul974.33  uO 

rO  10  tl 3  s4  110  lat!48  dlO  crO  ro. 921574  lal48  lap. 90034  latp. 901735  laav74.3227  116502  eO  szl. 58314  szs. 954594  ti62530.4  thl. 63202  lo263.904  ch27„706  chc. 736584  qdl9.9243  sschl 
6519  conn3. 23453  disc23 . 6834  pend. 230716  cpulOl 48 , 2  uO 

rO  10  t7  s29  16  lat-1  dlO  crO  ro3. 87013  la50  lap. 902459  latpO  laav4B.9863  i2440  eO  sz36.1324  szs20.8056  tll20102  th2. 86745  lo20.3161  ch40.?018  chcl. 34676  qdl. 00041  ssch8962  connl 
5.9099  dl sc23 .031  pend. 253072  cpu2703.23  uO 

rO  10  tl  s29  16  lat232  dlO  crO  ro2. 17502  la231  lap. 901122  latp. 908722  laavl31.007  113817  eO  sz36.3502  szs20.7552  tl270288  th7. 25862  io51.1195  ch40.0181  chcl. 17305  qd6. 96562  Ssch5 
1045  connl5.9164  disc22.8244  pend. 244746  cpul4127,3  uO 

rO  10  t7  s31  16  lat-1  dlO  crO  roll. 4571  la96  lap. 89892  latpO  laav69.2118  11296  eO  SZ134.397  szs78.3445  tl90083.3  ch7. 55282  lol4.3067  ch51.3217  chcl. 86782  qdl. 00077  sschl0886  conn 
26.0891  disc23. 5962  pend.  247275  Cpu2891.67  110 

rO  10  t?  s31  16  lat384  dlO  crO  ro3. 28456  la387  lap. 899878  latp. 859355  laav225.498  15734  eO  szl35.506  SZS82.2777  tl270569  thll.2243  lo21.1924  ch51.4578  chcl. 5999  qd4.8556  ssch4775 
2  conn26. 5622  dlsc23.2314  pend. 235162  cpul0920.8  uO 

rO  10  t7  s32  16  lat-1  dlO  crO  ro34.1177  la285  lap. 900289  latpO  1 aavl 73 . 793  1692  eO  SZ625.069  szs346.822  tll20497  thl4.0223  lo5. 74288  chl37.605  chc6. 07034  qdl. 00145  ssch6795  connl 
04.922  disc28 . 2079  pend. 231869  Cpul802.68  uO 

rO  10  t7  s32  16  latll40  dlO  crO  ro4. 12009  lall43  lap. 901361  latp. 897959  laav770.7  1882  eO  sz606.287  szs361.784  tll20747  thl7.2994  lo7. 30456  chl35.607  chc7. 49206  qd5. 72109  ssch864 
0  ccnnl02.626  disc26.7509  pend. 231985  cpul903.84  uO 

rO  10  t7  s42  16  lat-1  dlO  crO  rol7.7719  lal41  lap. 69905  latpO  laav94.0532  1842  eO  sz257.48  SZS149.159  tl0O145.8  thlO.5666  lol0.5058  ch71.8674  chc2 . 45907  qdl. 00119  ssch7861  conn45 
.2567  disc24 . 2773  pend. 235598  cpu2059.14  uO 

rO  10  t7  s42  16  lat564  dlO  crO  ro3. 64391  la565  lap. 9  latp. 9  laav420.17  11130  eO  sz254.466  szsl55.022  tl80296.5  thl3.9885  lol4.0728  ch71.9261  chc3. 26208  qd5. 98053  sschl0470  conn45 
.1323  disc24 .4134  pend. 232662  cpu2339.99  uO 

rl  10  tl3  s3  110  lat?88  d20  crl  rol. 35353  la795  lap. 099757  latp. 893917  laav514.663  12055  eO  SZ395.247  szs246.818  tll00684  th31.5124  lo20.4104  ch94.5148  chc4 . 78664  qdlO.5985  sschl 
9628  conn68.1244  disc22.8789  pend. 231043  cpu4606.16  uO 

tl  10  til  s4  110  lat 14 8  d20  crl  ro. 969344  lalSl  lap. 900531  latp.  897212  laav79.2317  19093  eO  szl. 5788  szs. 939662  U13977.5  th4. 01204  lo650.548  ch24.7844  chcl. 10495  qd53.2063  ssch9 
128  connl. 22619  disc20.699S  pend. 230198  cpu5842.51  uO 

rl  10  t7  s29  16  lat232  d20  crl  ro3. 06421  la231  lap. 899987  latp. 904119  laavl27.527  115260  eO  sz36.3325  SZS20.6334  tll50178  thl4.4213  iol01.613  ch37.9218  chcl. 26953  qdl3.205  ssch62 
175  connl 5. 916  dlsc20.6744  pend. 233653  cpul8256  uO 

rl  10  t7  s31  16  lat384  d20  crl  ro4. 42954  la390  lap. 899823  latp. 89516  laav258.036  16221  eO  SZ133.754  SZS60.8085  tilS0385  th21.6133  lo41.3671  ch40.4263  chcl. 79233  qdlO.7635  ssch567 
68  conn26 . 2967  dlsc20.4106  pend. 232316  cpul3850.4  uO 

rl  10  t7  s32  16  latll40  d20  crl  ro8. 98049  lall55  lap. 900037  latp. 093673  laav757.148  12676  eO  sz626.499  szs356.164  ti210702  th31.0811  1O12.7004  chl37,226  chc5. 71585  qd9. 69507  ssch 
28629  connl05 . 632  disc26.7549  pend. 231195  cpu68B2.13  uO 

rl  10  1 7  s42  16  lat564  d20  crl  ro5. 97754  la562  lap. 899277  latp. 90506  laav382.237  12076  eO  SZ251.758  szsl48.742  tl80571.4  th25.339  lo25.766  ch69.234  chc3. 50043  qd9. 97832  ssch21509 
conn44 . 892  dlse21.9054  pend. 231732  cpu5109.77  uO 

rl  10  t8  s29  16  lat232  d20  crl  ro4. 31474  la235  lap. 899897  latp. 894758  laavl43.67  14865  eO  sz36.8602  szs20.8721  tl90140  th7. 77111  lo53.9716  ch39.8685  chcl. 34538  qd7. 81768  sseh3477 
4  connl5.9183  dlsc22.7539  pend. 232008  cpu9092.33  uO 

rl  10  t8  s31  16  lat384  d20  crl  ro5.3016  la381  lap.89776S  latp. 911555  laav274.772  12104  eO  SZ129.16  szs78.5525  ti90237.3  thll.7638  lo23.3163  ch50.4B72  chcl. 80293  qd6.4653  ssch3295 
2  conn25.6481  disc23.3169  pend. 233311  cpu7416.16  uO 

rl  10  t8  s32  16  latll40  d20  crl  ro9. 01628  lall31  lap.  901189  latp. 905764  laav764.642  11093  eO  sz640.S8  szs367.82  t!150785  thl8.1383  lo7. 24874  chl41,449  Chc6. 70374  qd5. 59469  ssch20 
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387  connlOS.  4]  8  dlsc28.8446  pend. 230559  cpu4521.42  uO 

rl  10  V,9  S3  130  ]  at  788  d20  Crl  ro6. 94645  la791  lap. 900358  latp. 897971  laav566.263  11676  eO  SZ392.589  SZS245.939  111  6054  9  thl6.009  iolO.4392  ch96.4786  cho3. 74037  qd5. 95227  ssch317 
67  conn68 . 24 6  dfsc25.4102  pend. 231602  cpu6728.31  uO 

rl  10  19  s4  110  lat 148  d20  crl  rol.5812  lalSl  lap. 901287  latp. 895945  laav77.9616  18254  eO  szl. 57487  szs. 933144  H32337.6  thl. 57023  io255.245  ch27.9017  chcl. 00846  qd20.4351  sschlfi 
534  conn3. 21909  dlsc23.8778  pend. 230321  cpu6881.83  uO 

rS  10  t 1 3  s3  no  lat/88  dll  cr5  ro4. 09699  la791  lap. 899763  latp. 89739  laav572.946  11686  eO  sz402.837  szs240.666  til60844  thl6.4946  lol0.4822  ch95.5716  chc4. 11441  qd6.0427  sschl76 
58  conn66. 94 24  disc25.5324  pend. 231412  cpu4060.99  uO 

r5  10  t 13  s4  110  latl48  dll  cr5  ro. 607716  lal43  lap. 899363  latp. 910124  laav71.8055  111635  eO  szl. 59424  szs. 983203  U40526.3  thl. 7879  lo287.098  ch27.7313  chc. 807752  qd20.8077  ssch 
11656  conn3. 25162  disc23.6965  pend. 230852  cpu4136.22  uO 

r5  10  1 7  s29  16  lat232  dll  cr5  ro2. 85085  Ia231  lap. 898946  latp.  904819  laavl22.95  U8219  @9131.75  5236.9497  szs20.9164  tl420315  th6. 25634  io43.346  ch39.5144  chcl. 19834  qd5. 84302  s 
sch78002  connlfi . 0085  disc22.2237  pend. 236517  cpu29700.7  uO 

r5  10  t7  s31  16  lat384  dll  cr5  ro3.084  la381  lap. 900746  latp. 908955  laav275.362  12680  e3841.76  SZ132.169  szs?9.422  tll20246  thll.5060  io22.2876  ch49.4233  chcl. 82597  qd6.1B918  ssc 
024665  conn24 . 9B97  disc22.81S7  pend. 233534  cpu6803.53  uO 

r5  10  t7  s32  16  latl!40  dll  cr5  ro4.4191  lall43  lap. 90005  latp. 896072  laav783.97  12011  el0135.1  S2604.968  szs350.04  tl271431  thl7.5083  lo7. 40888  chl28.548  chc5. 56605  qd5. 64286  ss 
ch224 65  conn96. 665  disc27.6126  pend. 231636  cpul3803.9  uO 

rS  10  t7  s42  16  lat564  dll  cr5  ro3. 55574  la563  lap. 903061  latp. 911565  laav421.372  11177  e2495.67  sz252.121  SZS157.685  tl804D6.1  thl4.4164  iol4.6382  ch68.9087  chc3. 48147  qd6. 24979 
sschl2150  conn42 . 6303  dise23.996  pend. 232749  cpu4847.04  uO 

rS  10  t6  s29  16  lat232  dll  cr5  ro5. 63128  la230  lap. 900372  latp. 909171  laavl29.848  110228  e44752.1  SZ37.1105  szs20.9776  tl540666  th2.7429]  lolB.9174  ch37.7292  chcl. 25717  qd2, 90673 
ssch86727  connl 6. 333?  dlsc20.0957  pend. 238739  cpu62857.3  uO 

r5  10  t8  s31  16  lat384  dll  ci'5  ro9. 77173  la381  lap.  900314  latp. 903552  laavl94.736  19881  ell3242  SZ133.603  szs?9.0477  tl811541  th6. 35428  lol2.1756  ch47.0787  chcl. 55016  qd2. 61036  s 
schl3 421 9  conn24 . 531 B  dlsc20.942  pend. 238007  cpu!  32789  uO 

r5  10  t8  s32  16  latll40  dll  cr5  rolO.0212  lall51  lap. 900133  latp. 890812  laav817.735  1751  ©33267.8  SZ588.465  szs339.585  til20460  thl4.331  lo6. 23441  chl00.93  chc6. 84744  qd5. 14647  s 
schll774  conn?4.152  disc23.3471  pend. 232159  cpu30616.6  uO 

-  r5  10  1 9  s3  110  lat788  dll  cr5  ro5. 98854  la764  lap. 900366  latp. 904936  laav541.84  11094  e35558.4  sz393.229  szs241.965  tll20518  thl3.9435  io9. 07748  ch82.7963  chc4. 18272  qd4. 95247  s 
schl4763  conn56.8818  dlsc23.0959  pend. 232085  cpu32813.9  uO 

r5  10  1 9  s4  110  latl48  dll  cr5  ro2. 06456  lal49  lap. 902746  latp. 902746  laav90.6663  110634  el954.09  szl. 5773  szs.  932404  U148196  th.  442113  lo71.7562  ch21.8322  chc. 753286  qd6. 69466 
ssch42560  conn3. 22528  discl7.8261  pend.2310B6  cpul3401.3  uO 

rO  1  17  S29  16  lat-1  dlO  crO  ro7. 73289  la56  lap. 902314  latpO  iaav46.00SS  11945  eO  SZ33.2889  szsl9.669  tl90089.5  th2. 80741  lo21.5896  ch30.5946  chc. 916292  qdl. 00051  sschl8477  conn6. 
44455  dlsc23.2542  pend. 264611  cpu4825.3  uO 

rO  1  t7  s29  16  lat232  dlO  crO  ro2. 55908  la233  lap. 901587  latp. 901587  laavl39.956  18505  eO  sz32.940S  szsl9.925  tl270268  th4. 04921  io31.4688  ch30.8584  chc. 769077  qd4. 44860  ssch80220 
conn6. 43139  disc23.5296  pend. 234319  cpul8134.4  uO 

rO  1  t7  s3  16  lat-1  dlO  crO  ro23.9002  lal96  lap. 899257  latpO  laavl23.794  11211  eO  sz387.073  szs231.863  tl!50318  thl2.1811  io8. 05625  ch95.113  chc3. 54668  qdl. 00003  sschl2043  conn64. 
9685  dlsc27 .1360  pend. 234445  cpu3143.29  uO 

rO  1  1 7  s3  16  lat 780  dlO  crO  ro3. 02699  la779  lap.  900747  latp. 901814  laav609.637  1937  eO  SZ377.909  szs237.067  tl90399  thl5.3011  iolO.3652  ch93.1064  chc5. 38106  qd6. 42263  ssch9357  eo 
nn63.3425  dlsc26.7515  pend. 23202  cpu2031.33  uO 

rO  1  t7  s4  16  lat-1  dlO  crO  rol. 15352  la39  lap. 909317  latpO  laav29.7152  14014  eO  szl.6043B  szs. 964977  tll20068  th. 209516  io33.431  ch26.3915  chc. 703133  qdl. 00025  sscti6440  ccnn2.379 
07  dlsc23.2915  pend. 2368  cpu2317.86  uO 

rO  1  L7  s 4  16  latl56  dlO  crO  ro. 928234  lal61  lap. 900923  latp.  8941  67  laav78.8666  139233  eO  szl.  58879  szs. 962066  tl240083  thl. 01418  lol63.414  ch26.4914  chc.  628824  qdl3.5317  ssch6234 
4  conn2. 37875  disc23.3634  pend. 232461  epu23352.1  uO 

rl  1.  t7  s29  16  lat 232  d20  crl  ro4. 44936  la231  lap. 899166  latp. 903069  laavl23.014  116909  eO  SZ32.6747  szsl9.9487  tl300255  th7.  18785  io56.3155  ch29.4699  chc. 810805  qd7.307  sschl7495 
7  conn6. 38933  disc22.133  pend. 234056  cpu43507.4  uO 

rl  1  t7  s3  16  lat780  d20  crl  ro6. 88464  la779  lap. 900589  latp. 901325  laavS15.895  12716  eO  sz384.149  szs239.659  tll50829  th27.0214  lol8.0072  ch93.2314  ehe3. 67827  qd9. 39065  ssch30142 
conn64.5031  dlsc25.6089  pend. 231756  cpu6903.47  uO 

rl  1  1 7  s4  16  lat 148  d20  crl  rol. 22001  lal51  lap. 90007  latp. 896695  laav75.3431  197974  eO  szl. 5811  szs. 960012  t!294089  th2. 05756  lo333.144  eh25.0773  chc. 724723  qd26.2907  ssch30142 
conn64 . 5031  disc25.6089  pend. 231756  cpu68444.5  ul 

rl  1  tB  s29  16  lat232  d20  crl  ro5. 93334  la234  lap. 898673  latp. 895095  laavl20.842  18666  eO  sz32.7045  szsl9.8944  ti270167  th4. 09783  lo32.0765  ch30.9715  chc. 786318  qd4. 26321  sschl543 
71  conn6. 40718  disc23.6597  pend. 233436  cpu34952.5  uO 

rl  1  L8  S3  16  lat 780  d20  crl  ro7. 20171  la778  lap. 899789  latp. 901547  laav470.597  12844  eO  SZ391.748  SZS239.674  ti270528  thl6.0873  lol0.5128  ch95.4276  chc3. 04602  qd5. 01653  ssch54099 
conn65 .7574  disc26.8727  pend. 231452  cpull690.8  uO 

rl  1  t8  s4  16  latl48  d20  crl  rol. 92286  lal48  lap. 899743  latp. 90199  laav80.2482  115595  eO  szl. 57961  szs. 951869  tl90092.3  thl. 06809  iol73.1  ch26.5941  chc. 793674  qdl3.9965  ssch46889 
conn2. 37917  dlsc23.4471  pend. 230866  cpul4644.3  uO 

r5  1  t7  s29  16  lat232  dll  cr5  ro2. 43385  la230  lap. 901062  latp. 913351  laavl69.638  14801  ell72.91  sz32.7955  szsl9.8368  tll50233  th4. 09393  1031.957  ch29.7166  chc. 806434  qd5. 46095  ssc 
h51725  conn6. 09009  dlsc22.7391  pend. 233738  cpul3068  uO 

r5  1  t7  s3  16  lat780  dll  cr5  ro4. 21554  la793  lap. 899001  latp. 091232  laav482.898  12703  ©6329.08  sz394.772  SZS244.064  tl270698  th!5.3981  lo9.9853  ch92.3669  chc3.6301  qd4. 88383  ssch3 
1074  conn62 . 9252  disc26.4083  pend. 231627  cpul7177.5  uO 

r5  1  t.7  s4  16  latl48  dll  cr5  ro.9948B  lal40  lap. 90088  latp.  902434  laav78.219S  132176  e624.420  szl. 59286  szs. 966013  ti210141  th.  952709  lol53.116  ch25.1121  chc. 642416  qdl2.2544  ssch 
63102  conn2. 37966  disc21.985  pend. 231973  cpu20688.6  uO 

r5  1  t8  s 29  16  lat232  dll  crS  ro6. 51337  la235  lap. 90095  latp. 896814  laavl.22.764  18945  el8019.2  sz32.6714  szsl9.862  H420599  th2. 71419  lo21.2673  ch26.2734  chc. 766277  qd2. 84919  ssch 
131494  connS. 55325  dlscl9.8511  pend. 242029  cpu48603.3  uO 

r5  1  t8  S3  16  lat 780  dll  cr5  ro6. 33618  la785  lap. 900138  latp. 897837  laav531,504  12173  e50430.4  sz393.314  szs234.853  tl241076  thl3.8486  lo9. 01375  ch70.3827  chc2.8312  qd4. 84768  ssch 
34738  conn4 6. 0647  disc21.9238  pend. 231777  cpu53704.4  uO 

r5  1  tB  s4  16  latl48  dll  cr5  ro2. 25727  lal47  lap. 898938  latp. 904248  laav92.505S  111490  el960.69  szl. 60139  szs. 989694  tll80140  th. 398994  lo63.7836  ch21.63  chc. 683325  qd5. 96084  ssch 
56319  conn2. 38635  disclB.S007  pend.  23242  cpul.7063.2  uO 

rl  10  tlO  s3  16  lat/80  d20  crl  roV. 38959  la779  lap. 900877  latp. 906945  laav5S9.419  11483  eO  sz383.635  szs230.499  tll20841  this. 3909  lol2.2723  ch94.9682  chc4. 12938  qd6. 94268  ssch239 
48  conn66.3359  disc25.7914  pend. 231777  cpu5374.19  uO 
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rl  10  tlO  s4  16  latUB  d20  crl  rol .  37462  la!53  lap. 900629  latp. 893088  laai/76.7683  L24657  eO  szl.  59302  szs.  963642  tl87676.7  thl.  74999  lo281.226  ch27.7173  chc. 85931  qd22.0134  ssch41 
890  conn3. 24669  disc23.6539  pend. 230232  cpul7987.5  uO 

rl  10  111  s3  16  iat780  d20  crl  ro9. 70465  la796  lap. 900578  latp. 89191  laav446.498  158B4  eO  sz392.544  szs240.B38  t!451104  th20.0006  iol3.043S  ch96.B005  chc3. 04431  qdS. 94697  ssch8444 
7  conn68.2936  dlsc25.4802  pend. 231445  cpul9720.6  uO 

rl  10  til  s4  16  ]atl48  d20  crl  rol. 13477  lal49  lap. 899982  latp. 899982  laav73 .7727  15582  eO  szl. 58259  szs. 948459  til6564.2  th2. 08076  to336.585  ch27.3734  chcl. 28574  qd25.3432  ssch63 
29  conn3. 23636  disc23.3269  pend.228B91  cpu3548.17  uO 

rl  10  tl2  s3  16  lat780  d20  crl  ro8. 81903  la795  lap. 900541  latp. 89027  laav477.84  11850  eO  sz390.129  szs237.911  tll20960  th23.3076  iol5.2943  ch95.2072  chc3. 95255  qd7. 46649  ssch23215 
conn67 , 3031  disc24.7709  pend. 231624  cpu5427.43  uO 

rl  10  tl2  s4  16  latl48  d20  crl  rol. 05331  lal43  lap. 900764  latp. 910519  laav70.4278  120852  eO  szl. 58316  szs. 953423  tl52768.8  th2. 44374  10395.158  ch27.0144  chc. 90114  qd28.4276  ssch27 
072  conn3. 22938  disc22.9556  pend. 2307  cpol2668.2  uO 

rl  10  1 7  s3  16  lat780  d20  crl  ro7. 31506  la777  lap.  899642  latp. 903823  laav526.545  13351  eO  sz393.677  szs233.723  tll80860  th28.4926  iol8.5281  ch94.6119  chc4. 21389  qd9. 86273  ssch3544 
3  conn67. 6844  dtsc23.6592  pend. 231619  cpu8428.74  uO 

rl  10  t7  s4  16  lat!48  d20  crl  rol. 14824  lal42  lap. 900116  latp. 910812  laav70.8236  113874  eO  szl. 59478  szs. 986644  t!27662.8  th3.1244  io501.539  ch25.9125  chcl. 08618  qd36.3416  sschl53 
11  conn3. 26141  disc22.?997  pend. 230979  cpul0319.1  uO 

rl  10  t8  s3  16  lat780  d20  crl  ro7.0149  la794  lap. 900815  latp. 890285  laav509.254  12944  eO  sz390.914  SZS236.423  tl271229  thl6.5745  iolO.8543  ch96.178  chc3. 15155  qd5. 59952  ssch53S53 
cor.n67.3689  dlsc25.9602  pend. 231518  cpull779.7  uO 

rl  10  1 8  s4  16  latl 48  d20  crl  rol. 70633  lalSl  lap. 899304  latp. 894863  laav77.6186  18383  eO  szl. 58833  szs.  944376  t.133757.5  thl.  54074  lo248.33  ch27.9492  chcl. 10145  qdl9.7613  sschl599 
9  conn3. 23857  dlsc23.896B  pend. 230574  cpu7835.77  uO 

r5  10  tlO  S3  16  lat780  dll  cr5  rol. 41159  la793  lap. 899746  latp. 892766  laav577.S72  11576  e36216.7  sz390.728  szs233.813  tll81052  thl3.2858  lo8. 70468  ch78.6607  cho3. 74227  qd5. 07931  s 
sch22771  conn53 .7901  dSsc22.1997  pend. 232127  cpu37084.2  uO 

r5  10  tlO  s4  16  latl48  dll  cr5  rol. 7003  lal45  lap. 900766  latp. 910573  laav79.2716  128351  e3672.57  szl. 58023  szs. 96712  C1351994  th. 497178  io80.544  ch22.4552  chc. 716772  qd7. 10811  ssc 
688009  conn3. 22789  dl SC18 . 4  534  pend. 230932  Cpu2 9665 . 7  UO 

15  10  til  s3  16  lat780  dll  cr5  ro6. 20801  la793  lap. 900777  latp. 892409  laav535.168  11675  628253. 4  SZ394.983  szs245.341  tll80675  thl4.3039  lo9. 27078  ch64.099  chc4.0096  qd4. 99045  ssc 
h21837  conn57.6201  disc23.5878  pend. 231905  cpu28553.8  dO 

r5  10  til'  s4  16  latl48  dll  cr5  rol. 31896  lal44  lap.  8999  latp. 913606  laav77.5995  110015  e919.557  szl. 58233  szs. 957294  U86460.1  th. 715964  loll5.834  ch23.0894  chc. 758186  qd9. 09446  s 
sch24891  conn3. 23277  dlscl9.0679  pend. 231347  cpu8543.07  uO 

r5  10  t 1 2  s3  16  lat780  dll  cr5  ro6. 06121  la790  lap. 899854  latp.B96451  laav475.538  12057  e20464.9  SZ395.77  szs234.019  C1210776  thl5.0875  lo9. 75917  ch87.389  chc3. 71401  qd4. 66845  ssc 
h24749  conn60.3137  dlsc24.1277  pend. 23246a  cpu22773.2  uO 

r5  10  tl2  s4  16  latl48  dll  cr5  rol. 0421  lal45  lap. 900354  latp. 908641  laav73.5337  124869  el357.6  szl. 57602  szs. 951592  U171062  th. 895004  lol45.38  ch23.9855  chc. 710389  qdll.3079  ssc 
h47011  conn3. 20936  dlscl9.9964  pend. 23104  cpul6743.2  uO 

r5  10  t7  s3  16  lat780  dll  cr5  ro4. 07356  la779  lap. 900552  latp. 90292  laav579.534  11267  e4451.46  sz391.711  szs234.774  C1120693  thl6.0627  iolO.4977  ch91.55  chc4. 78054  qd6. 16101  sschl 
3896  conn63.2224  disc25.2504  pend. 231166  cpu6859.24  uO 

r5  10  t7  s4  16  lat.148  dll  cr5  ro. 744581  lal52  lap. 899452  latp. 894407  laav76.7026  122809  e437.237  szl. 57565  szs. 969248  til01909  thl. 37756  io223.bl6  ch25.8772  chc. 714765  qdl7.4603  s 
sch29782  conn3. 21999  disc21.8715  pend. 231446  cpull274.2  uO 

r5  10  1 8  s3  16  lat780  dll  cr5  ro8. 26841  la785  lap. 9  latp. 899444  laav5S6.377  11800  e57045.7  sz401.173  szs247.472  ti220911  thl2.7687  lo8. 14809  ch77.9747  chc3. 34912  qd4.565  ssch27790 
conn53 .2878  disc22.0059  pend. 232394  cpu54164.3  uO 

r5  10  t8  s4  16  latl48  dll  cr5  rol. 94845  lal49  lap. 9  latp. 9  laav87.5946  120341  e3368.52  szl. 57426  szs. 966197  ti277651  th. 450515  io73.261  ch22.0298  chc. 720801  qd6. 82031  ssch75215  co 
nn3. 22321  disc38.0324  pend. 230877  cpu24776.2  uO 


